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Ie INTRODUCTION 


ee oe ee eee eee ee eee ee 


Ae STATEMENT OF TRS FRCOaren 


This thesis wili focus on the evaluation of the award 
fee determination process in Cost Plus Award Fee  (CPAF) 
COneEracts-. The conceptual framework cor CPAF contracts was 
formed in the late 1950's and early 1960's. The Navy was 
one of the first Agencies to use CPAF contracts in the early 
1960's. Because the award fee determination iS Subjective , 
unilateral, and post performance decision on the part of the 
Government, the amount of the award fee ana the process Dy 
which the award fee is determined is subject to criticism 
from internal Navy sources, Congress and industry. An 
attempt will be made to evaluate the award fee determination 
process to explore how it might be improved in order to 


ensure the Government pays a "fair and reasonable" price. 


Be OBJECTIVES AND RESEARCH QUESTIONS 


The objective of this research effort is to study and 
evaluate the award fee determination process in major weapon 


systems acquisition in an attempt to improve the process. 
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The research questions which, if answered, would achieve 


the objective are as follows: 


‘io 


Primary guestion: 

What are the key characteristics of the award fee 

determination process under CPAF contracts for major 

weapon systems and how eee this process be 
improved? 

Subsidiary questions: 

a) What are the basic concepts and assumptions in the 
award fee determinaticn process? 

b) What are the key criteria used to evaluate 
contractor performance and how nave these criteria 
been utilized? 

c) What are the significant issues and problems in 
contractor performance evaluation? 

d) What guidelines are used by the Fee Determination 
Official in determining the quality of contrac- 
tor's performance and amount of award fee? 

e) What input does the contractor have in the award 
peemoe eee iaaaion process? 

£) What modifications should be made to improve the 
fee determination process? 

g) How are funds utilized which remain in the "award 
Fee pool" after the award fee determination deci- 


Sion is mnadé? 


1 


h) The amount oz the award free is limited by the size 
of the award fee pool. In measuring the award fee 
aS a percentage or the award fee pool, what 


trends, if any, are evident? 


C. sCOBRE 


This thesis will evaluate the award fee determination 
process and award fee concept as used with CPAF contracts in 
Major weapon systems acguisiticn within the Department of 
the Navy. While many topics could be discussed concerning 
CPAF contracts, this thesis will focus only on the award fee 
determination process in ot [et ea the award fee in the 
CPAF contract and in the prcper administration of the 


CONtEACT. This process will ke examined in detail inan 


attempt to make recommendations for improving the process. 


De. STUDY LIMITATIONS AND ASSUMETIONS 


The research will be limited by the accessability of 


data available from the academic environment, Naval Material 


Command, Naval Air Systems Command, Naval Sea Systems 
Command, and the willingness of private contractors to 
cooperate. 


The following assumptions have been made in the research 


process: 
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iit mcWemOr1gind! GecisSion to use a CPAF contract was 
PEOpemmaiaecndemcne CONMtilact type for the the partic- 
ular Situation used is net to be addressed. 

2. That the contracts selected for examination are 
representative of the totai CPAF contract population. 

3. That the findings and recommendations are appropriate 
for other Agencies to ccnsider and are not strictly 


Navy oriented. 


E. METHODOLOGY 


The literature concerning the development and use of 
award fee contracts, specifically CPAF contracts, is exan- 
ined inthis thesis. Sources for this literature were 
General Accounting Office audit reports, Defense Logistics 
Studies Information Exchange, Air Force Business Research 
Management Center, Naval Postgraduate School library, and 
the Administrative Sciences Department library. 

Interviews were conducted and data obtained fron 
personnel in the following positions and for the following 
purposes: 

1. Fee Determination Officiais to examine the decision 
Making process used to determine the amount of the 
award fee, management of the award fee pool, review 


inputs received from Performance Evaluation Board 
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members, and gain.insight into the degree of accept- 
ance of the award fee contract. 

2. Members of Performance Evaluation Boards to examine 
their level of acceptance and assumptions inherent in 
the award fee process. 

3. Contract policy staff members at the Assistant 
Secretary of the Wavy and Naval Material Ccmmand to 
evaluate aajor factors, characteristics, and frasic 
concepts of the award fee process. 

4. Contractor representatives to “gain insight into 
contractor's views toward the award fee process. 

Data from eighteen CPAF contracts representing four 
different Project Offices was ortained for review and anal- 
ysis. The approximate total cost estimate for these 
eighteen conten exceeded $2.271 billion. These data were 
provided to the researcher [ty evaluation period, and 
included the amount of funds available in the award fee pool 
to be awarded during the evaluation period and the amount 
actually awarded. Included in the eighteen contracts were 


117 individual evaluation periods from which trend analysis 


will be conducted. 
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Fe. ORGANIZATION 


The first half of this research effort is designed 
around what is available in the literature. Chapter If 
presents some historical backgreund of CPAF contracts; the 
‘conceptual framework as seen in the literature covering the 
elements of an award fee contract, the evaluation criteria, 
and the award procedures; folicwed by the applications and 
advantages as well as disadvantages of CPAF contracts. 
Chapter III is designed to give the reader some background 
On using profit as a motivational tool. If award fee 
contracts are intended to motivate the contractor, then it 
behooves Contracting Officers and others interfacing with 
the contractor to understand the driving forces which noti- 
vate the contractor. 

The second half of the thesis resulted from conducting 
interviews and gathering data from the various individuals 
contacted. Chapter IV addresses the concerns and elenents 
used when structuring a CPAF contract. These are pre-award 
concerns which the Project Manager and Contracting Officer 
would want to address in formulating the contract and 
submission for a pre-business clearance. Such elements as 
the base fee, award fee pool, valuation criteria, evalua- 
mom period length, and fee computation formulas are 


discussed. Chapter V addresses the issues and concerns 


i) 


involved with administering (CeAr iconuracw. Items Ga 
interest include the Performance Evaluation Board composi- 
tion and proceedings, as well as the role and authority of 
the Fee Determination Official. Chapter V concludes with an 
examination of trend analysis of award fees from data gath- 
ered during the course of research interviews. 

Chapter VI is designed to Summarize the research by 
reaching conclusions, making research recommendations, 
responding to the research questions, and making recommenda- 


tions for further study. 
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II. BACKGROUND AND CONCEPTUAL FRAMEWORK 


A. INTRODUCTION 


The Cost-Plus-Award-Fee (CPAF) contract is a member of 
the family of cost-reinbursable contracts with special fee 
provisions. CPAF contractS are Characterized by the unique 
method in which the amount of the contractor's fee is deter- 
Mined. Generally, an award fee is an incentive that can be 
paid by the Government to a contractor. The objective of 
the award fee provision clause in a contract is to encourage 
the contractor to surpass the Minimum acceptable performance 
Standards established for certain areas that are described 
by what is referred to as the "evaluation criteria." A CPAF 
contract provides a means of applying an incentive to 
contracts which are not susceptible to a finite measurement 
of performance necessary for structuring most incentive 
contracts, and as such, reguire a subjective evaluation. 
The fee established in a CPAF contract consists of two 
parts. The first part is a base (or fixed) fee. Award fee 


guidelines allow the contractor to receive a base fee which 


does not vary with contract performance. The size of the 
base fee will be discussed later in this chapter. An award 
a 


1g 


fee contract also provides for a maximum fee. The diftieme 
ence between the maximum fee and base fee is referred to as 
the "award fee pool." The amount of the pooi awarded to the 
contractor is contingent upon the level of contractor 
perrormance during a pre-specified performance period, 
usually three to six months. This award amount is intended 
to provide motivation for the ccntractor to excel in various 
areas or contract performance such as quality, timeliness, 
ingenuity, and cost effectiveness. The amount of award fee 
awarded to the contractor may ke ail that is available in 
the award fee pool or only a fart of that which is avail- 
able. The exact amount is based upon a subjective evalua- 


tion of the guality of the contractor's performance, judged 


on the basis of criteria originally included in jm 
COM Erack. The award fee 1s determined by the Government 
representatives i1n a unilateral decision, which is not 


subject to the Disputes Clause cr the contract [Ref. 1}. 

The purpose of this chapter is to introduce this rela- 
tively new type of contract Ey reviewing the historical 
background, the conceptual framework necessary for struc- 
turing a CPAF contract, situations/conditions under which 
CPAF contracts are appropriate for use, and advantages and 


disadvantages of CPAF contracts. 
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Be. HISTORICAL BACKGRCUND 


Variants of award fee provisions were first itplemented 
in Federal Government aircraft maintenance and overhaul 
contracts during the late 1950's {Ref. 2]. During the 
period 1958 through 1961, Professor Frederic MN. Scherer, of 
Harvard University, participated as a faculty team member in 
the Weapons Acquisition Research Project which was conmmis- 
Sioned by the Ford Foundation to explore the relationship 
petween industry and the Government in weapon systems acgqui- 
Srtion. Proressor Scherer was the first to publish recon- 
mendations for the use of "After the Fact Evaluation in 
Profit Determination" in 1962. It was his belief that award 
fee provisions would be particularly useful in the research 
and development (R & D) phases of najor systems acyuisition 
programs where determining costs, Proauct qualicy, and 
schedules in advance of performance was difficult {Ref. 3]. 
AS such, in this researcher's ofinion, Professor Scherer may 
well be considered the "father of CPAF contracting." 

( on addition to Professor Scherers!' work, several other 
independent planning actions were considering the use of 
award fee contracts during 1961 and 1962. Both the Navy and 
National Aeronautics and Space Administration (NASA) were 
negotiating award fee contracts in 1962 [Ref. 66]. NASA is 
aecunally credited with being the pioneer in CPAF 
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contracting. The Navy's logistic Support Contraeu mor merees 
ations at Kwajalein Island, effective in July 1962, combined 
a cost-plus-incentive-fee (CPIF) arrangement for cost 
control with an award fee provision for a subjective evalua- 
tion of staffing control, personnel turnover, and quality of 
performance [Ref. 5]. On 1 March 1964, the U.S, Navy 
Purchasing Office, los Angeles, awarded the Navy's first 
Moure"™ CPAF contract for operation and tmaintenance of 
instrumentation systems and test range facilities {Ref. 6]. 

In addition to the Navy, NASA also played an actave 
role in the development of CPAF contracts. The Goddard 
Space Flight Center first negotiated a CPAF contract 
covering operation, maintenance, and engineering services 
for the Mercury Manned Space Fiight Network. Although this 
was the first CPAF contract negotiated, it did not become 
effective until 1 January 1963. NASA's first CPAF contract 
to actually be awarded was dated 1 October 1962. haa S 
contract was negotiated by the Space Nuclear Propulsion 
Office, Cleveland, Ohio, and covered research and develop- 
ment efforts for a Nuclear £Eowered Rocket Engine(NERVA) 
fRef. 7]. 

The Armed Services Procurement Regulation Committee 
originally approved the use of CPAF contracts for experi- 
mental purposes within the Department of Defense (DOD) in 


1963 [Ref. 8]. It is not clear to the researcher how the 
= 


Ze 


Nayvyeeewas able to award a centract for the support of 
Kwajalein Island with award fee provisions in 1962; it nay 
have been an individual Armed Services Procurement 
Regulation (ASPR) authorized deviation with the ASPR 
committee later deciding to aliow a class deviation for 
everyone on an experimental basis, however support for this 
theory could not be found. At first, use of CPAF contracts 
were thought to be viable only in level-of-effort type 
comeracts; with the first five applications of CPAF 
contracts under the test used for procurement of technical, 
engineering, and support services [Ref. 9]. The Navy 
expanded use of CPAF contracts within two and one-half years 
following the test approvai to include the procurement of 
research and development, naval architectural design, and 
Bemstruction {fRef. 10]. The researcher believes that this 
expansion by tne Navy of CPAF contract use into the area of 
research and development may re directly attributable to 
Professor Scherer's earlier work in this area. 

During the first four years of experience with award fee 
provisions, a total of 140 DOD and NASA contracts, valued in 
excess of $1.1 billion, were awarded to nearly 90 civilian 
Comtractors [Ref. 11]. While NASA and all DOD Agencies 
(Departments of the Army, Air Force and Navy) used CPAF 
contracts in the early years, the Navy and NASA appeared to 
be the pioneers and made the most extensive use of this 


Sontract type. 
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The CPAF contract iS gaining acceptance within both the 
Government and industry. During Fiscal Year (FY) 1982, CPAF 
contracts were used in one-half of one percent of all DOD 
contracts in excess of $10,000, which also represents 3.5 
percent of neteedellar ewelue Oi ORY 1982 comvractex 
Additionally, in FY 1982, CPAF contracts represented 7.4 
percent of the net dcllar value of all Navy contracts. CPAF 
contracts aS a percentage of total numbers of contracts in 
excess of $10,000 used by the Navy was 1.5 percent in FY1982 
(Refs Zag The differences between the percentayes indi- 
cates that the award fee contracts represented a larger 
dollar value than the average ccntract. 

According to the DOD and NASA Incentive Contracting 
Guide, "the objective of an incentive contract is to noti- 
vate the contractor to earn more compensation by achieving 
better performance and controlling costs" [Ref. 13]. The 
NASA Cost Plus Award Fee Contracting Guide indicates that 
experience has shown that CPAF contracts have generated 
tangible beneficial and motivational responses, both from 
Government and industry. Communications, in partie mia 
have become more effective between the Government and the 
CONtTHAGTOr s In addition, the CPAF concept has demanded and 
has resulted in improved definition of tasks (Statement of 
Work); both Government and industry have used CPAF proce- 


dures aS Management tools to communicate to supervisory, 


administrative, and oferating levels {Ref. 14]. 
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Simees its eeconcertion an the late 1950's and early 
M960'S, use of the CPAF concept haS grown to represent a 
powerful management tool. Tne researcher believes that the 
increase in use of CPAF contracts, to 3.5 percent of the net 
DOD dollar value for FY 1982 contracts, indicates that 
industry has begun to accept the subjective evaluation 


process inherent in the concept. 


C. CONCEPTUAL FRAMEWCRK 


Now that we have examined listorical development, how is 


a CPAF contract structured? 


ieee nrrements of an Award Fee Contract 


Petesesimpiest £Lorm, a CPAF “Contract will contain 
the following elements: estimated cost, base fee, Mmaximun 
fee, award periods, and evaluation criteria. 

Estimated costs should be negotiated on a fair and 
equitable basis petween the Government and contractor, and 
Should represent the Lest estimate of what actual costs will 
be upca completion of performance. Estimated costs are 
apalogous to target costS in a CPIF contract. 

The base fee is the @inimumn dollar amount of fee 
that a contractor can earn ona CPAF contract and may in 


fact be zero. The base fee is designed to provide the 
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contractor with an adeguate fee for performing to the 
Minimum standards. As such, the base fee is Synonymous with 
the minimum fee ona CPIF contract. However, the DOD 
Supplement to the Federal Acguisition Regulations (FAR) 
limits the amount of the base fee to three percent of esti- 
mated costs [Ref. 26}. 

As mentioned earlier, tne difference between the 
bkase fee and maximum fee is called the award fee pool and is 
that amount available for award to the contractor on the 
basis of the results of periodic evaluations. The award fee 
pool should be ailocated to the evaluation periods in 
proportion to the level of effort expected to be required 
during each period. 

The maximum fee can be described as the base fee 
plus the amount in the award fee pool. The controlling 
requirement limiting the size of the maximum fee is the 
regulatory limitation that this fee will not exceed the 
Statutory limitation oh COQSst reimbursement contracts; 
Ramely, 15 percent of target (estimated) costs for research 
and development efforts, six fercent for architectural or 
engineering services related to public works functions, and 
10 percent for all other types cf contracts [Ref. 27]. This 
means that if the minimum fee is established at three 
percent (the maximum allowed), then the award fee amount 1s 


limited to 12 percent of estimated costs for research and 


gevelopment eiforts, three percent for architectural or 
engineering services, and seven percent for ali other types 
Pemeeontracts. 

The award periods must be long enough to cover 
sufficient work to enable a reasonable base upon which to 
develop the evaluation, but shcrt enough to allow feedback 
to the contractor during performance. An evaluation period 
of three months may be too short to justify in that the 
increased administrative effort necessary to make the evalu- 
ations becomes too much of an administrative burden. An 
evaluation period of a four or Six month length may be nore 


appropriate. 


WeeeerstadDlishing the Evaluation Criteria 


The evaluaticn criteria and standards for making the 
award are the basis for the ultimate award. Toe evaluation 
criteria set forth the elements of the contractor's perforn- 
ance which will be used by the Government in determining the 
award amount. The greatest challenge with a CPAF contract 
lies in the MENeTeY of the evaluation criteria structure and 
the rating plan. The importance of a well-defined, well- 
written evaluation plan cannot be over-emphasized. The 
evaluaticn criteria should identify the weighting of various 


factors and include guidance as to the level of performance 


required for specific rating levels. The DOD Supplement to 
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the FAR requires that the evaluation criteria be included in 
the contlact / fer. Zam: 

While the evaluation criteria must be fully under- 
stood by the contractor, the selection of criteria is not a 
subject of negotiation in some agencies. The final selec- 
tion iS a unilateral decision by some Government Agency 
negotiators [Ref. 29]. The advantage of the unilateral 
issuance of evaluation criteria 1s that they can be changed 
by the Government during contract performance if it becomes 
necessary, in the Government's opinion, to redirect the 
contractor's emphasis. 

In general, the evaluation criteria should be fair 
and reasonable measures of performance in key areas. They 
Should also be flexible to enakle adaptation to a changing 
environment while continuing tc motivate the contractor to 
improve performance. 

Performance criteria 1n award fee contracts must be, 
by definition, subjective. Tc properly choose appropriate 
performance criteria, it 1s necessary to command a thorough 
knowledge of both managerial as well as technical areas of 
the project. 

No two evaluation and rating plans will be identical 
in all respects; each must be tailored to the specific needs 
and oa ae In addition, evaluation criteria should 


be tailored to a limited number of key elements which are 
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critical to the project's success. Examples of key elements 
Might include technicai, quality, managerial, schedule, cost 
control, and personnel utilization. Once the key elements 
are decided upon, these categcries may be further divided 
into criteria for evaluating the elements that make up eacn 
performance category. The inclusion of sub-elements is also 
a feasible alternative. Appendix B contains the examrpie of 
award criteria provided in DOD Supplement to the FAR, 
section 16.404-2. 

Because the Government is more interested in results 
rather than effort, evaluation criteria should be geared to 
Pvaemeacing ‘output’ rather than "input" {Ref. 30]. AS suca, 
the criteria selected must represent attainable goals; 
otherwise the motivation to the contractor may be lost. 

There are many methods for establishing rating plans 
and evaluation criteria. As mentioned earlier, no two 
Systems will be identical; a system must be selected which 
best fits the requirement. The system of standards nost 
commonly used is the adjective-type standard rating systen 
Which indexes a performance quality adjective and corre- 
sponding explanation to a percentage of the potential award 
fee available during the evaluation period [Ref. 31]. While 
Appendix 3 showS one example recommended by the DOD 
Supplement to the FAR, the following is an example of an 
adjective evaluation standards system recommended by NASA: 


[Ref. 32] 
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in EXCeilenn: Represents 91 to 100 percent of the 
potential award fee. Performance is outstanding in most 
respects, approaching the best that could be perforned 
by a @Ualliged Ceontrseron, Contractor nas greatly 
exceeded quality, schedule, cutput and overall perforn- 
ance which would be expected of an average contractor. 
Areas of deficiency are very few and relatively unimpor- 
Ean Le nature. Contractor shows initiative am 
executing job and invoking improvements. 


ee Good: kKepresents 81 to SO percent of the potential 
award fee. Performance is substantially better than 
standards. Contractor has mere than met all needs, aas 
substantially improved upon guality and schedules, has 
exceeded the performance expected of an average 
COntEaeLorm. Areas of deficiency are relatively few and 
are more than offset by areas of above average or excel- 
lent performance. 


as Satisfactory: Represents 771 to 80 percent of the 
potentiai award fee. Performance is adeguate, overall. 
Contractor has met all needs, schedule, and expectations 
in a fashion which corresponds to standard performance 
by a qualified contractor. Areas of deficiency are 
about offset by areas of above standard performance. 


4. Marginal: Represents 61 to 70 percent of the poten- 
tial award fee. Performance is below the standard 
performance expected of a gualified contlractes. 
Contractor is deficient ina significant number of 
areas. Performance in other areas 1s generally average, 
With few or no areas of above average performance. 


De Unsatisfactory: Represents 60 percent or below the 
potential award fee. Performance is deficient in 
substantial areas of effort. Immediate improvement is 
reyguired in order to permit continuation or the 
contract. Termination may be considered. 
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D. THE AWARD PROCEDUEE 


The award procedure is a three step process within the 
contracting agency which begins with Government monitors 
evaiuating contractor performance during the revorting 
period. Generally, the people used for this task are the 
technical and business personnei who are monitoring the 
contractor's work ona regular basis. These people nay 
include the Administrative Contracting Officer (ACC), 
Defense Contract Audit Agency (DCAA) auditor, and other 
Sigoree Lepresentatives. These people should be knowledge- 
able cf the contract requirements, the evaluation criteria, 
and technical areas. The goal of this part of ‘the process 
is to obtain the evaluation of the most knowledgeable 
personnel in the agency on each area of the contractor's 
performance. Findings of these individuals should be 
consolidated into periodic reports and forwarded to an award 
tee Perfcrmance Evaluation Board (PEB). The frequency of 
these reports will depend on the length of the evaluation 
period, but,- in the author's opinion, should be either 
nomeniy or quarterly. 

Step two in this process is a review of these evalua- 
tions by the PEB. The DOD Sufplement to the FAR indicates 
thatethisestep~i s»optional ({ Refs 33]. AS such, considera- 


tion Should be given to eliminating this step oon smaller, 


et 


less complex, procurements. If tae PEB were utilized, its 
function would be to review all evaluation reports and 
subjectiveiy determine a performance grade for each pre- 
established evaluation criterion and an overall performance 
grade for the period. The DOD Supplement to the FAR has a 
recommended format for a contractor performance evaluation 
report which is included in Appendix C for review jRef. 34]. 

The third step is the actual award Ly the Award-fee 
Determination Official (ADO). This individual is also often 
referred to as the Fee Determination Official (FDO). I£ the 
PEB is utilized, the PEB will forward the performance grade 
and recommended award fee amount to the ADO. There are no 
requirements which indicate that the recommended award fee 
amount is binding on the ADO. The ADO must either accept 
the PEB's recommendation, or determine a different award fee 
amount. If a PEB is not utiiized, the ADO must review the 
evaluation reports and determine an award fee amount. Tn 
major contracts, the ADO would te at the management level of 
the procuring activity (usually the Project Manager), while 
in smalier contracts, the contracting officer himself might 
perform this function. Once the ADO makes the initial award 
fee determination, a letter report is forwarded to the 
contractor providing informaticn on the performance grade 
and corresponding award fee, anda listing of ali areas of 


performance improvement which, if incorporated, may result 


52 


in potential additional award fees in future periods 
ner. 35}. The contractor haS anh opportunity to rebut the 
ADO's decision by presenting evidence in his favor 
[Ref. 36]. However, once the AIO (and possibly in consulta- 
tion with the PEB) has reviewed the rebuttal and final award 
fee determination made by the ALO, the decision is final and 


not subject to dispute [Ref. 37]. 


E. APPLICATION OF COST-PLUS-AWARD-FEE CONTRACTS 


The Federal Acquisition Regulation (FAR) and Department 
of Defense Supplement to the FAR state that CPAF contracts 


are suitable when: [FRef. 15 and 16] 


(1) The work to be performed iS Such that it is neither 
feasible nor effective to devise predetermined objective 
incentive taryets applicable to cost, technical perforn- 
ance or schedule; 


(a2: ) The likelinood of meeting acquisition objectives 
will be enhanced by using a ocontract that effectively 
motivates the contractor toward exceptional performance 
and provides the Government with the flexibility to 
evaluate both actual performance and the conditions 
under which -it was achieved; 


(i111) Any additional administrative effort and cost 
reguired to monitor and evaluate performance are justi- 
fied by the expected benefits; 


(iv) Level of effort contracts for performance of 
services where mission feasifility is established but 
measurement of achievement must be by subjective evalua- 
tion rather than objective measurement; and 


(v) Work which would have been placed under another 
type of contract if the perfcrmance objectives could be 
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expressed in advance py definite milestones, targets or 
goals susceptible of measuring actuai performance. 


The FAR does not place a fininum limit on the dollar 
size of CPAF contracts. NASA uses a rule of thumb that: 


[Ref. 18] 


Contracts for less than $100,000 may be placed on a CPAF 
basis if the contractor is providing critical support 
services or when the Significance of contemplated 
performance gains may far outweigh the additional admin- 
istrative expense. 


Although a minimum limit on the dollar size of CPAF 
contracts is not imposed by DOD, the Cnief of Naval Material 
(NAVMAT) does indicate that "award fee contracts should not 
generally be employed for contracts valued under $25 
Million" [Ref. 17}. Additionaliy, the FAR and DOD 
Supplement to the FAR place the following limitations on 


their use: 


as All of the limitations in 16.301-3 are conpliieg 
with! 


1A cost-reimbursement contract may be used when: (a) 
The contractor's acccunting system is adequate for deter- 
Mining costs applicable to the contract; (b) Appropriate 


Government surveillance during performance will provide 
reasonable assurance that efficient methods and effective 
cost controls are used; and (c) A determination and findings 


34 


(11) The maximum fee payable {i.e., tne base fee plus 
the highest potential award fee) complies with the limi- 
Parmems in 15.903-die 


(2251) The contract amount, performance period, and 
expected benerits are sufficient to warrant the addi- 
i: ema L administrative effort and costs involved; 
[Ref. 19] 


(iv) The CPAF contract shall not be used as an adminis- 
trative technique to avoid CPFF contracts when the 
Serteria for CPFF contracts apply, nor shall a CPAF 
contract be used to avoid the effort of establishing 
objective targets so as to make feasible the use cfa 
Geir type contract; 


(Vv) The CPAF contract shall not be used where the 
contract amount, period of ferformance or the benefits 
expected are insufficient tc warrant the additional 
administrative effort or cost; and 


(vi) The CPAF contract shall aot be used for procure- 
ments categorized as either Engineering Development or 
Operational 'System Development which have undergone 
contract definition, except that where it may be nore 
advantageous to do so, it may be used in these catego- 
ries for individual procurements, ancillary to the 
development of a major weapon system or equipment, where 
the purpose or the procurement is clearly to determine 
or solve specific problems associated with the major 
weapon system or eguipment. [Ref. 20] 


has been executed, in accordance with agency procedures 
showing that (1) this contract type is likely to be less 
eestly tham any other typey or (2) it iss impractical to 
obtain supplies or services of the kind or quality required 
without the use of this contract type. 


2To be discussed later in this chapter. 
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It is important tosmote that if the Ce@et of g@iimieae 
tion of a CPAF contract is in excess of any benefits which 
may accrue to the Government, a contract form other than 
CPAF should be utilized. The problem then becomes one of 
how to measure the Fenefits and costs of administration; 
which is beyond the scope of this thesis. In additaeme 
award fee provisions should not be used when another 
contract type would be more appropriate, such as when evalu- 
ation criteria can be objectively measured. Such an example 
would be a CPIF contract with multiple incentives. 

It has been demonstrated that CPAF contractsS are partic- 
ularly appropriate for use in the procurement of sSupoort 
services generally associated with base maintenance and 
operations and mission support contracts. For example, the 
researcher believes that it may be a viable option to use 
CPAF provisions in the contracting out of base medical 
Support services under Office of Management and Budget (OMB) 
CLEC ular A —7 oO. Another example would be the operation ard 
maintenance of the computer center at the Naval Postgraduate 
School. 

As will be seen in Chapter IV, the Navy has expanded the 
use of CPAF contracts into the acguisition of major weapon 
systems. The develcpment Phase of major weapon systems 
acguisition appears to be well-suited for CPAF use. This 
would also represent the largest doilar applications of CPAF 


uSe. 
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Although award fee provisiors are most commoniy used in 
CPAF contracts, use of the award fee concept is not limited 
strictly to one contract type. Section 16.404-2(c) of the 
DOD Supplement to the FAR provides some flexibility in the 
use of this concept. There May be times when the 
contracting officer desires to rrovide some form of notiva- 
tion to the contractor which is both objective and subjaec- 
tive. For example, logistic support, quality, timeliness, 
cooperation, ingenuity, and cost effectiveness are areas 
under management control which may be evaluated only subjec- 
tively. A contract in which the majority of the fee 
(BEOLit) is subject toa Fixed Price Incentive (FPI) 
arrangement and a minority is subject to an award fee 
arrangement, would be termed a FPI/AF contract. A CPIF/AF 
contract would be where the majcrity of the fee was subject 
to a cost pius incentive arrangement with a minority subject 


to an award fee arrangement. 


Fe. ADVANTAGES AND CISADVANTAGES oF COST-PLUS-AWARD-FEE 


CCNTRACTS 
1. Advantages 


The advantages of CPAF contracts are numerous and 
varied. Ore advantage, identified by several interviewees, 


iS aS a motivational management tool for both Government and 
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industry resulting in improved horizontal aud” verte 
communication (1i.e., between Government and industry as well 
as up and down all levels of the corporate structure). One 
Program Manager indicated tnat aS a management tool, the 
Government is more effectively able to influence the 
contractor and project progress during the contract period. 
Excellence by the ccntractor is rewarded with higher award 
fees. Similarly, poor or substandard performance results in 
lower award fees. Additionally, one BusSiness/Financial 
Manager fointed out that depending upon how the contract is 
structured, the evaluation period may be of a short enough 
duration that the contractor can receive "nearly inSameeae 
neous" feedback on his performance. The more timely the 
feedback, the better it is fer the contractor because it 
allows timely adjustments by the contractor. This cause- 
and-effect relationship between performance and profit can 
result in the contractor making modifications to his proce- 
dures to become more efficient, and hence earn higher award 
fees during subsequent evaluaticn periods. 

Even without frofit aS a motivator, the evaluation 
itself can be a positive motivational tool. The award fee 
evaluation can enhance the pride of the organization through 
the managers and other employees [Ref. 21]. Just as ia 
viduals have basic and higher order needs that must be 


Satisfied (i.e., food, shelter, security, self esteem), so 
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too dO Corporations have needs. Once the firm's lower level 
needs are satisfied (i.e., survival, profit, growth, Market 
share), prestige becomes the primary motive. The award fee 
acts aS a corporate motivator to the extent that it is 
perceived by the firm to affect its prestige. 

The award fee concept also allows for management 
flexibility, as pointed out by one Business/Financial 
Manager. This flexibility can take several forms. Because 
the amount of award fee determination 1S a subjective evalu- 
ation, with performance being measured with predeternined 
standards which keep changing, management can remain flex- 
ible to take into consideration unexpected/unplanned circun- 
Stances while stiil aliowing the contractor to earn up to 
the maximum amount of the award fee, if appropriate. A 
second rorm of flexibility in award fee contracts is the 
Government's right to change the evaluation criteria in an 
effort to redirect the contractor's emphasis. Still another 
technigue which provides flexibility to management 1S the 
Government's ability to divide and assign the award fee to 
various periods depending upon the milestones toe Government 
wishes to emphasize. The amount availabie in the award fee 
pool need not be evenly divided among every evaluation 
period. Likewise, depending upcn how the contract is struc- 
tured, any award fee available in the pool which is not 


awarded during a particular evaluation period, may be either 
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carried forward to subSegquent feriods to provide for addi- 
tional contractor motivation, or lost by the contract ora 
removed from the pool.? The Government also nas the flexi- 
bility to determine the length of the evaluation periods. 
However, care must be taken in making this determination. 
Evaluation periods which are toc short will place an unnec- 
essary administrative burden on the contract administrators 
and other personnel. On the other hand, in the researcher's 
opinion, an evaluation period which is too long reduces the 
motivational aspects discussed earlier when the contractor 
does not receive timely feedback. 

NASA discovered that improved performance is not 
iimited to areas motivated in the award fee plan, but are 
times extends to improvementS cn othec Government contracts 
currently in existence within the corporation [Ref. 22}. 
Called the "overflow" principle, NASA indicated that, "Once 
a contractor begins making decisions in consonance with the 
guidelines of the contract, the results of related nonincen- 
tivized contracts also improve" [Ref. 22]. 

Still another advantage, ae the researcher's 
Opinion, is that use of a CPAF contract forces the prepara- 


tion ot a well-defined Staterent of Work (SOW). The 


3The Navy recently restricted use of the carry forward 
feature in NAVMAT Instruction 4280.140f 10 July 1984. This 
will be further examined in Chapter IV when discussing use 
of the award fee pool. 
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Smitmdetor, Ledaigang that his award fee depends upon satis- 
ee: the desired emphasis to be placed on specific perfora- 
ance areas, benefits from more explicit direction than he 
would abave received under a Cost-Plus-Fixed-Fee (CPFF) 
coutract. In developing the SOW, the contractor seeks 
higher fees tarough better perfcrmance ard the Government is 
looking for the best possible standards against which to 
make the required evaluations. 

Stitt dme@ther advantage, @or the contractor,eis that 
a CPAF contract provides the ability to earn higher fees. 
While most CPFF service contracts earn a 7 or 8 percent fee, 
a well structured CPAF contract can provide fees from 190 to 
v2 Pereent for superior performance [Ref. 23]. As indicated 
by a number of interviewees, this aas led some people to 
refer to CPAF contracting as a "give away" program. 

One last advantage is that CPAF contracts can be 
used by contractor management ag a motivational tool for the 
corporate employees [Ref. 24]. Dr. Arthur C. Meiners advo- 
cates development of a system which would allow employees 
working to Pesnort a CPAP cComtract to participate directly 
in the award fee process with bcnus payments. As the amount 
of the award fee increases, so would the financial rewards 
to the various employees. Such a contract would be called 


Cost-Plus-Award-Fee, Employee Participation, CPAF(EP). 
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Disadvantages for the use of CPAF contracts do 
exist. Ferhaps the one major disadvantage, as identified by 
one Cost Analyst,is the extensive Government organization 
necessary to properly administer the contract. Contractor 
performance must be monitored closely by technically guali- 
fied personnel who are knowledgeable of the requirement for 
fairness and impartiality, the intent of the incentives, and 
how evaiuations will be used. They must also have the time, 
motivation and guidance to prepare evaluations which are 
meaningful to both the Government and the contractor. 
' Evaluators must understand that their function is to eval- 
uate the contractor, not become a participatory member of 
the centractor's management tean. Toey must also be knowl- 
edgeable of the téchnical performance required by the 
CON trace. if the Government does not have the necessary 
resources available for commitment to properly administer a 
CPAF contract, some other contract type should be utilized. 

This disadvantage highlights a need which is not 
currently being satisfied. Numerous personnel interviewed 
for this research pointed out that a formalized training 
program for CPAF contracts does not exist. This is particu- 
larly critical with CPAF contracts because of their unrigue 


features. Personnel working with award fee contracts must 
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Po EaaMedmine teria or GOontractcr motivation factors, evalu- 
ation criteria and methods, ccntract administration tech- 
nigues, potential for abuse and Misuse, responsibilities of 
those who monitor contractor performance and provide inputs 
and testimony to the PEB, as well as other factors unique to 
CPAF contracts. Structuring such a training program and 
Manual is beyond the scope of this thesis. 

Timely evaluation is also a critical factor as indi- 
cated by a number of interviewees. The Government must 
conduct the evaluation, determine the amount of fee to be 
awarded, and notify the contractor of the results in a 
timely manner. Delays in this process will result in the 
contractor losing motivation for increasing efficiency. 

As will be discussed later, an award fee contract 
does not have a target fee as one of its elements. Because 
of this, the Government must fully fund the anount of the 
maximum award fee. Failure to do so will signal to the 
contractor that the fuli amount of the award fee 1S imdos- 
Sree to attain fRef. 25]. In an environment of tight 
budgets, it fs unrealistic to expect that a Program Manager 
would, or could, request additional funding in order to 
reward the contractor. Failure to fully fund the nmaxinun 
award fee will also send a sSignai to the evaluators that the 
reduced figure is what the Government really had in mind as 
the maximum from the beginning. In addition, it just makes 


for sound business management tc fully fund the project. 
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Ge. CONCLUSION 


Use of the award fee concept 1S continuing to grow since 
its conception in the late 1950's and inatiad utilizatwongees 
the early 1960's. The CPAF contract can be an effective 
incentive technigue when understood and properly applied. 
However, because the evaluaticn process is subjective and 
the determination of award fee amount a unilateral decision, 
Success of the award fee concept depends on the Government's 
ability to maintain the credibility and integrity of the 
evaluation process. In addition, the award fee concept 
demands the active support of both the Government and 
contractor personnel to properly administer the contract and 
mManajye the unique administrative requirements. Lack of 
complete management support and the failure to maintain the 
credibility and integrity of the evaluation process, guickly 
reduces the effectiveness of the award fee contract. 

An unbiased, fair, and reasonable measure of performance 
is also critical to the success of the CPAF concept. The 
contractor must be properly mctivated to strive for more 
efficient and better performance in an erfort to receive a 
higher award fee. Ihe unilateral selection of evaiuation 
criteria by some Government Agencies is of concern to the 
researcher. In order to be "fair and reasonable" to both 
the Government and to the contractor, the contractor should 


have an input into the development of evaluation criteria. 


Gy 


In an attempt to Fetter understand how award fees can be 


used aS an incentive (or notivating) POC tt 1S first 
necessary to recognize those factors with which the 
contractor can in fact be motivated. In the reSearcher's 


opinion, the DOD profit policy assumes that profit (or award 


fee) alone is enough to motivate the contractor. Is this 
really the case? Are there not other factors which can act 
to motivate the contractor? These questions will be exan- 


ined in Chapter III. 
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LIft. PROFIT AS A HOLTIVATLOUAL Teor 
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A. INTRODUCTION 


The below paragraphs represent the Government's profit 
policy as it currently exists in the Federal Acquisition 


Regulation (FAR): 


It 1S in the Government's interest to offer contractors 
opportunities for financial rewards sufficient to (1) 
Stimulate efficient contract performance, (2) attract 
the best capabilities of qualified large and small busi- 
ness cencerns to Government ccntracts, and (3) maintain 
a viable industrial base. 


Both the Government and contractors should be concerned 
With profit asa motivator of efficient and effective 
contract performance. Negctiations aimed merely at 
reducing prices by reducing profit, without proper 
recognition of the function of profit, are not ite 
Government's interests. Negotiation of extremely low 
profits, use of historical averages, or automatic appli- 
cation of predetermined percentages of total estimated 
costs do not provide proper motivation for optimun 
contract ;erformance. With the exception of statutory 
ceilings on profit and fee, agencies shall not (1) 
establish administrative ceilings or (2) create adminis- 
trative procedures that could be represented to contrac- 
tors as de facto ceilings [Ref. 38]. 
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This policy statement 1S Suppiemented with a Department 


of Defense (DOD) statement as indicated below: 


Furthermore, low average frofit rates on defense 
contracts overall are detrimental to the edo) lee 
interest. Effective national defense ina free enter- 
prise economy reguires that the best industrial capabil- 
ities be attracted to defense COmpnacCeS . These 
Capabilities will be driven away from the defense market 
if defense contracts are characterized by low profit 
opportunities. Consequently, negotiations aimed merely 
at reducing prices Ly reducing profits, with no realiza- 
tion of the function of profit, cannot be condoned. For 
each contract in which profit 1S negotiated as a sepa- 
rate element of the contract price, the aim of negotia- 
tion should be to employ the profit motive so as_ to 
impel effective contract performance by which overall 
costs are economically contreclled. To this end, the 
profit objective must be fitted to the circumstances of 
the particular acquisition, giving due weight to each of 
the effort, risk, facilities investment, and special 
factors set forth (in weighted guidelines). This will 
result in a wider range of profits which, in many cases, 
will tke Significantly -higher than previous norms 
Pret. 39]. 


The above policy statements indicate that it is the 
Government's belief that profit is the basic motivating 
force behind the contractor. There is an implied assumption 
on the part of the Government that the contractor will be 
properly motivated if given the opportunity to increase his 
profits. The contractor, by accepting the contract, appears 


to be agreeing with the Government. 
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Brigadier General Bernard L. Weiss, USAF, recently indi- 
cated that large corporate DOD contractors should be treated 
as "public utilities" and implied that these corporate 
giants have a monopoly over the supply of their unique 
derense product while the consumer (DOD) has little if any 
power over the contractor to refuse the product at the 
contractor's price once Congress has authorized the progran 
and appropriated funds. [Ref. 40]. Furthermore, General 
Weiss indicated that corporate profit goals are to attain 
adequate levels, not adequate rates. 


Herein lies the dilemma. Are contractors strictly noti- 


vated by the "profit motive" as the Government's profit 
policy implies, or are the ccntractors motivated by some 
other forces? Clearly, it is the belief of Government and 


DOD policy makers that profit maximization is the frrime 
industry motivater for improved performance. Additionally, 
it is clear that it is DOD's intention to use profits to 
motivate contractor performance. The purpose of this 
Chapter is to explore the profit motive and examine those 
forces which act to motivate and influence contractor's 
performance. 

To gain a better understanding of the present profit 
policy, it would be helpful tc briefly examine the histor- 


ical development of this policy. 
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PeeeeuaolLORECAL PERSPECTIVE 


Historically, purchasing by the Government has been on 
the basis of price competition and, as such, negated any 
need for a profit policy. It was felt that the competition 
in the market place among independent contractors would 
result in the Government receiving a fair and reasonalle 
price {Ref. 41}. 

Cost-plus-percentage-of-cost (CPPC) contracts were used 
regularly during the 1930's. A general iack of competition 
resulted in an increase in the number of contracts negoti- 
ated on either expected or actual costs [Ref. 42]. ia al 
CPPC contract, the profit or fee is determined by applying a 
mmeeam percentage to the costs incurred. Therefore, as costs 
increased, so did profits. If costs decreased, profits aliso 
fell. The contractor was therefore motivated to actually 
increase his costs! Responding to public pressure, Congress 
passed numerous legislative actions designed to control 
abuses such as CPPC CORmeacts. @s exampie, the 
Vinson-Trammeli Act of 1934 limited profits to ten percent 
on Navy ships and aircraft and reguired audits and inspec- 
tions of contractor records [Ref. 43]. 

The potential for contractor fraud, waste and abuse 
Surfaced again during World War II with a shortage of 


Supplier capacity, resulting in the Renegotiation Act or 
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1942. This Act called for the renegotiation of both prine 
and subcontracts in excess of $100,000 and made possible the 
recovery of excessive profits along with unallowable costs. 
The Renegotiation Board also established profit as a 
percentage of sales cn individual contracts as the measure 


of profmipabiamity. 


1. Initial Policy Statement 


The first formalized folicy statement addressing 
profit appears to have been included in the Armed Services 
Procurement Act of 1947 which states that for negotiated 


contracts: 


The fee for performing a cost-plus-a-fixed-fee contract 
for experimental, developmental, or research work nay 
not be more than 15% of the estimated cost of the 
contract, not including the fee. The fee for perfcrnming 
a cost-plus-a-fixed-fee contract for architectulaiees 
engineering services for a public work or utility plus 
the cost of these services to the contractor may not be 
more than 6% of the estimated cost of that work or 
project, hot including the fee. The fee for perfcrming 
any other cost-plus-a-fixed-fee contract may not be more 
than 10% of the estimated cest of the contract, not 
including the fee [Ref. 44]. 


There were no statutory limits flaced on profits under fixed 
price contracts, except on those which nay have been consid- 


ered as "excessive" by the Renegotiation Act. 
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A more general profit pclicy statement also appeared 


in the Armed Services Procurement Regulation (ASPR) in 1947 


aS « 


The Department of Defense must apply contracting poli- 
cies and methods designed to create an environment in 
which industry can realize profits on defense business 
Which are high enough to give reasonable assurance of 
long term availability to DOD aindustrial support by the 
best companies and to enable those defense contractors 


to 


attract sufficient equity and borrowed capital 


[Ref. 45]. 


During the 1950's, the profit policy outlined in 


ASPR developed into a narrative form which lacked specific 


guidance on the relationship between profit elements to be 


considered when arriving at the appropriate profit level for 


negotiated contracts. Nine prcfit elements were identified 


ase 


Effective competition; 

Degree of risk; 

Nature of work to be performed; 
Extent of Government assistance; 
Extent of contractor's investments; 
Character of ccntractor's business; 
Contractor performance; 
Subeemtracting: and 


Unrealistic estimates [Ref. 46]. 
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The varied nature of these nine profit elements and amount 
of subjectivity inherent in evaluating each element without 
specific guidelines made the contracting personnel's task 
more difficult than was necessary. The predominant factor 
was the "historical rate" established on previous contracts. 
Contracting officers used the above nine profit elements 
only to adjust profit rates to fit specific procurement 
Situations [Ref. 47}. 

Inadequacies in a formalized profit policy continued 
and became visible in the early 1960's. The Senate 
Committee on Government Operations (also known as the 
McClellan Committee), while investigating a DOD missile 
program, found that primes and subcontractors were pyra- 
mMiding profits and thus were teing paid unearned prefits 
[Ref. 48}. The results of this investigation and subseguent 
publicity resulted in the Logistics Management Institute 
(LMI) being tasked to study DOD's profit policy. The objec- 


tive of this study was to: 


Develop a rational, workabie, uniform and equitable 
approach to target profits which will result in a wider 
range Of SroOLrimre- The study aims to develop specific 


guidelines to assist contracting personnel in arriving 
at appropriate profit rates to further national and 
departmental interests utilizing the profit notive of 
DOD contractors [Ref. 49}. 
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2. Weighted Guidelines 
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in August 71963, the Department of Defense imple- 
mented for the first time the "weighted guidelines" approach 
by revising the Armed Services Procurement Regulation 
[Ref. 50 j. Weighted guidelines were a direct result of the 
first LMI study [Ref. 51]. The guidelines were intended to 
ensure consideration was made of the relative value of 
maepmopetate factors in initadal establishment of a profit or 
fee objective. The evaluaticn factors to be considered 
were: 
1. Contractor input to total performance; 
feeeecoutractual assumption of contract cost risk (tyre of 
contract, reasonableness of cost estimates, diffi- 
eli y OF meeeaee task) ; 
3. Record of contractor performance; 
4. Selected factors (source of resources, special 
achievement) ; 
5. Special profit consideration (development of military 
items without Government assistance) [Ref. 52]. 
Although weighted guidelines were considered an 
improvement over prior methods and represented a new method 
to determine profit, three characteristics basic to the old 
system remained intact. First, asSsignnent of the basic fee 


cate was based on the personal judgement of the contracting 


ore. 


Ort leer. Second, the fee rate was based on the estimated 
cost.of the comendec. Finally, the fee rates failed to 
consider the contractor investment in plant equipment or 
working capital [Ref. 53]. Additionally, ASPR was again 


revised to reflect the new profit policy: 


It is the policy of the Department of Defense to utilize 
profit to stimulate efficient contract performance.... 
Negotiation of very low profits, the use of historical 
averages or the autcmatic application of a predetermined 
percentage to the total estimated cost of a product, 
does not provide tne motivation to accomplish such 
perfcrmance.... The profit okjectives must be fitted to 
the circumstances of the particular procurement, giving 
due weight to each of the performance, risk, and other 
factors [Ref. 54}. 


Weighted guidelines drew mixed reactions and was the 
subject ofa great deal of study during the 1960's and 
1970's. Concern existed over declining profits, low produc- 
tivity within defense industries and an eroding industrial 
base. In analyzing the results and impact of weighted 
guidelines, a RAND Corporation study in 1969 concluded that: 

1. Most firms had higher target fee rates after intro- 
duction of the weighted guidelines approach, but 
average realized fee rates ("coming-out" rates) 


appear to have remained about the same. 
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2. The weighted guidelines method resulted in spreading 
the distribution of going-in target fee rates. 

3. The objective was achieved, 1f the goai of the metaod 
was to increase profit cpportunities, regardless of 
whether or not they were achieved, by providing 
higher levels cf target ees. 

4, The goal was achieved, if the goal was to provide a 
wider distribution of average fees. 

5. The goal was not achieved, 1f the goal was to 
increase actual fees, rather than target fees. 

6. Results appear to have Feen mixed and on the whole 
unsuccessfui, if the gcal was to raise the profit- 
ability of defense investment [Ref. 55]. 

It appears clear from the above discussion, in the research- 
er's ofinion, that the purpose and goals of the weighted 


guidelines approach were not fully understood. 


3. Erofit 76 (DPC 76-3) 


The last significant study concerning profit and 
Peotit policy “was Gaumned "(Profit  "76!"., Chartered in May 
1975 by the Assistant Secretary of Defense £1 
Installations, William P. Clements, and chaired by Brigadier 
General James W. Stansberry, the goal was to "develop any 
policy revisions considered necessary to encourage private 


investment in eguipment and tke associated reductions in 
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cost" [ Ref. 56 }. This appears to be another way of saying 
treduce DOD acquisition costs." The study eventually led to 
a change in DOD regulations entitled Defense Procurement 
Circular 76-3 (DPC 76-5)" her. 7a 

Assistant Secretary Clements and Brigadier General 
Stansberry recognized a need to conduct research to analyze 
earnings and capital investments, determine contractors! 
profitability in both defense and non-defense industries, 
analyze contractor motivations leading to investments 
designed to increase productivity and lower cost, and 
Eima iva develop profit objectives designed to stop the 
apparent erosion of the defense industrial pase [Re£. 36]. 
The results of the study and DPC 76-3 made two major changes 
to DOD's profit policy in the hopes of raising the level of 
contractor facility investments for the defense industry. 
The first modification allowed the level of facility invest- 
ment to ke recognized by the Gcvernment contracting officer 
in reaching a prenegotiation vrofit objective. Secondly, it 
permitted the imputed interest cost of the contractor's 
facility capital investment, as measured in accordance with 
Cost Accounting Standard 414, to be used as an allowable 
cost on most negotiated contracts [Ref. 59]. 

In the researcher's opinion, DPC 76-3 appears to be 
the groundwork for the weighted guidelines in use today. 


While there have been additional changes made throughout the 
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years, they have ail been designed to adjust (increase or 
decrease) weights assigned to various criteria used in 
determining profit (i.e., DAC 76-23). | 

The same concerns which existed inthe 1960's and 
1970's continue to exist today. AS RADH J. S. Sansone, Jr., 
SC, USN, indicated on 12 Julv 1984, recent research studies 
have verified: 

1. An eroding defense industrial base; 

2. A limited surge/mobilization capability; 

3. Capital investment in the Defense segment is low; 

4. Productivity growth has keen very limited; 

Bee cOLcit policy {DAC 76-23) has not motivated contrac- 
tors to make significant capital investments; 

6. There are general misunderstandings of the DOD 
Iinance policy, both within Government and the 
private sector {Ref. 60]. 

According to RADM Sansone, the harsh realities experienced 
by the U.S. industry are that operating profits have 
deciined while cost of capital has dramatically increased 
[Rer. 60]. It is obvious that, in the researcher's opinion, 
the current profit peclicy is net as effective as originally 


intended. 
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C. CONTRACTOR MOTIVATION 


Profit has continued to be the driving force iam 
contractor motivation Since the completion of the Profit 76 
study in terms of a Department of Defense policy statement. 


The Defense Acquisition Regulation (DAR) stated: 


It is the policy of the Department of Defense to utilize 
profit to stimulate efficient contract performance. 
Profit generally is the basic motive of business enter- 
prise. The Government and defense contractors should be 
concerned with harnessing this motive to work for more 
effective and econcmical contract performance [Ref. 61]. 


1. EFroztit Maximization 


In addition to DOD's prefit policy, there appears to 
be a great deal more support to indicate that profit maximni- 
zation is the single most motivating factor for defense 
industries. Most undergraduate and graduate level 
economics, finance, and business courses are structured 
around the principle that a firm's desire iS to maximize 
DEGiant. As Gerald T. Nielsen indicated, "nost business 
oriented decision makers today have been so ingrained with 
the principles of profit maximization that the concept seems 


aimost intuitively obvious" [Ref. 62}. 
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Under the classical "profit maximization" assump- 
tion, contractors are expected to shun lower free effort in 
favor of an arrangement that permits higher profit potential 
[Ref. 63]. Dr. Peter Drucker, a strong advocate of the 


classical profit motive, indicates: 


Pmoaguet2on Lor profit 1s the principle of rationality 
anad efficiency on which the corporation must base 
peeself.... And the demand that some criterion other 
than profitability be used as a determinant of economic 
actions rests on a misunderstanding of the nature of the 
economic process.... [Ref. 64] 


In addition, Julius Jones and Russell Pierre, in an 
Air Force Institute of Technoiogy (AFIT) thesis found profit 
to pe the prime industry motivator. Profit maximization 
stood out as the single most important factor motivating the 
fifty defense industry firms surveyed, with sales maxiniza- 
tion, £irm perpetuation, and attainment of certain socioeco- 
nomic goals identified as additional sub-goals [{Ref. 65}. 


Finally, the DOD and National Aeronautics and Space 


== a EE SE Ge ee ee em ee 


The paetit «motive is the essence of incentive 
eComreracting. Incentive contracts utilize the drive for 
financial gain under risk conditions by rewarding the 
Comeractoretirough “inereased profitefor  attadnaing cost 
(and sometimes performance and schedule) levels nore 
beneficial for the Government than expected and by 
penalizing him through reduced profit for less’ than 
expected levels [Ref. 66}. 
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Contractors do not necessarily seek maximum profit 
ohn every contract. There exist other motivational forces, 


such as concerns for follow-on business, growth opportuni- 


ties, or improvement of corporate image. These are often 
called "extracontractual motivators" [Ref. 67]. The Uss- 
Commission on Government Procurement indicated threat: 
[Ref. 67] 


Sometimes extracontractual influences may operate in a 
countervailing manner with the contractual objectives 
Specified in the contract. Government agencies gener- 
ally accept the concept that these extracontractual 
motivators are often bevond the control of the 
Government. 


But are they really beyond our control? What exactly are 
these extracontractual motivating factors and cannot the 
Government, once having identified them, use them to its own 
advantage? 

A study conducted by the Logistics Management 


Institute (LMZ) indicated thats) [ken Gam 


There is virtually unanimous ayreement among managers 
and analysts who have studied overall contractor notiva- 
tion that, in the short run, contractor management does 
Sacrifice short run profit on defense business in favor 
of achieving: 


1. company growth, 


2. increased share of the industry market, 
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Ber a better public image, 
#2. organizational prestige, 


Dis GameEy-oveG bDenciats fo ccmmercial business (commer- 
Glial spinoffs), 


6. greater opportunity for follow-on business, or 


a Greater sharehclder expectations for future growth 
ama, profit. 


Furthermore, the LMI study indicated that a company will be 
willing to accept a less (or Jlewer profit or fee) if doing 


so will provide an opportunity to: [Ref. 69] 


ile gain competitive advantage by engaging in develop- 
mental effort in areas of potential future business, 


Zs acquire or retain competent personnel in scarce 
disciplines, 

oe Spread fixed costs over a substantially broader 
base, or 


4. prevent a potential competitor from gaining entry to 
the market 


In summary, the LMI study states: [Ref. 70] 


Fhether management is operating in the company's 
interest or for its own personal gain, it does not 
attempt to Maximize profit or fee On individual 
Gentcracts. It attempts to optimize among many objec- 
tives, placing particular stress on those which 
contribute most to maintaining or improving market posi- 
tion and assuring the future strength of the firm. The 
drive for profit is not absent, but is constrained by 
aims which ultimately are more consequential. 


61 


Firms do indeed have more objectives than just 
PEO nla On any given contract, a contractor could have any 
of a number of objectives in mind. All other things being 
equal, a firm would tend to perform well on a contract it 
had just Signed. However, as Dr. Robert F. Williams pointed 
out in a recent article entitled "So What Does the Defense 
Contractor Really Want?", a firm has, as a higher order yee 
own set of objectives and is first motivated to maximize its 
own benerit-cost ratic [Ref. 71}. A firm may for example, 
find this ratio higher for the performance of one contract 
than for a second contract in its plant at the expense of 
the second, or it may find that completing a Government 
contract could threaten its survival. 

Die Williams' study indicated that Government 
personnel perceive the order of importance of defense indus- 
trial contractor objectives to be (in the order indicated) 
profit on sales, company survival, improved cash flow, 
development of dominant industry position, and return on 
investment. These objectives were followed by company 
growth, providing a good product, and finally public image 
[Ref. 72]. 

On the other hand, industry beliefs about its objec- 
tives were cuite different. Industry personnel felt that 
providing a good product was by far the most important 


objective, followed by maintaining a long term continuing 
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business relationshig, itenoved Cash flow, profit, and 


development of new capabilities. These were followed by 
public image and finally the use Or exceSS Capacity 
Immeft. 73). 


The researcher believes that there should be nore 
weight given to the concept of public image as a motiva- 
tional tool than either Government or contractors are 
willing to accept. Quality has been negiected in American 
industry over the years. Both Government and industry are 
just now waking up to the need to improve quality. There 
are a number of reasons for Eee nC ludaang An increased 
awareness for the critical need to improve reliability; to 
be able to compete with foreign manufacturers; and the even- 
tual cost savings through improved guality by reduced rework 
time and less scrap. This idea of improving the “corporate 
public image" through improved guality is also evidenced by 
Ford Motor Company's theme of "Quality 1s Job 1" and tne 
iiemecuetlorn of "Quality Circles" into many of the nation's 
industries. 

Additionally, the researcher believes that corporate 
prestige aS a motivational tool shouid also be given 
increased consideration, particularly when dealing with 
award fee contracts. One senior Navy Department policy- 
maker suggested that "corporate management views the Fee 


Determination Official findings more as a report card than 
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what tne awacd fee ccntributed to the bottom line." Another 
corporate officer for a large Navy contractor confirmed this 
view, with some reservations, indicating that "the score, or 
grade, is important to us; but I Can't say that iIt"S@igee 
important than the size of the award from the (award fee) 
poole! | 

In their thesis, An Assessment of Factors Which 


Motivate Navy Contractors, Michael Jaggard and 4Howard 
Cartwright indicated that contractor objectives can be 
divided into contractual objectives and long term ccrperate 
goais [Ref. 74}. They indicate that the two categories are 
related in that the collective objectives of performing all 
Government contracts must reflect the overall long tern 
corporate strategy. In addition, the foilowilng Praia 
contractual objectives of the Gcvernment contractor have all 
been cited aS prime business okjectives: Company growth, 
provide a good product, develor new skills, market share, 
guarantee of follow on work, "mastery" (a desire to control 
one's own destiny), tTiskeaver-vem safeguard proprietary 
interests, utilize excess capacity, flexibility to customer, 
and improved cash flow [Ref. 75 j- 

Jaggard and Cartwright also identified three methods 
to determine the contractual objectives of a contractor for 


a specific contract [Ref. 75]. First, a post-performance 


review of contractual outcomes and associated benefits to 
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Biemcontractor can be conducted. Inherent in this approach 
is the necessity to wait until performance is completed to 
conduct the review. Socongywa list of possible. contractual 
objectives can be provided to the contractor who can be 
reguested to rate the relative importance of each objective 
as it pertained to performance on recent contracts. a aes 
list" approach may lead to biased responses. The 
third method is simply to ask the contractor to list the top 
three objectives that a firm hcped to attain by performing 
eiemcontract. The researcher suspects that a weakness in 
this approach may occur 1£ the contractor attempts to play 
"mind games" by providing those objectives the contractors 
think the Government wants to hear. 

The researcher would also like to propose a fourth 
method to determine contractor objectives. This method 
involves evaluating the contractor in terms of his strengths 
and weaknesses, the economic environment, the competitive 
environment the contractor operates in, as well as the size 
and maturity of the contractor. Each of tnese factors may 
shed sone light on the contractor's objectives in terms of 
profit. For example, if the basic economy is in a recession 
WEth relatively high unemployment in the industry, a 
contractor may be willing to accept a lower profit and put 
increased emphasis on corporate survival and maintaining his 


labor force. Conversely, periods of economic growth may see 


65 


defense contractors willing to accept additional risks in 
the nopes of achievihy higher profits. Firms involved with 
research and development activities may see the development 
of new capabilities, maintaining a long term business rela- 
tionship, and estabiishing a dominant industry position as 
more important motivators than profit. Smaller firms may be 
concerned with company survival rather than profit. Growing 
firms, on the otner nand, may Le more concerned with profit 
and return on investment than rapidly growing or mature 
firms. Finally, organizations with technicaily competent or 
"state-or-the-art" contracts may see obtaining a dominant 
market position as more important than profit. 

As Professors Greer and Liao pointed out in their 
paper "Contractor Hungriness and the Kelative Profitability 
of DOD Business," it is well known that when tae economy 
weakens, resulting in a growth of excess manufacturing 
capacity, real prices tend to decline with weakened profit 
margins [Ref. 76]. As a result, when demand falls, firms 
tend to engage in vigorous price competition. The amount of 
profit reduction contractors are willing to accept should 
therefore be inversely related to the decline in capacity 
utilization. Because the Government iS a powerful buyer, 
contracting officers should be able to take advantage of 
Situations where excesS capacity exists to drive “hard 


bargains" and buy products at lewer profit margins. On the 
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other hand, when the economy ig strony and there is suffi- 
cient cemmercial and Government business to utilize full 
capacity, the Government must be wiiling to pay the contrac- 
tors a profit rate which at least reaches parity with the 
commercial sector. Otherwise, industry would have no incen- 
tive to accept Government contracts. 

Des Racharad FP2 DeMong and Dr. Daniel E. Strayer 
propose that firms are primarily profit oriented only under 
economic conditions of pure competition and then only when 
there is cwner control of the firm [Ref. 77]. They are 
proponents of other mctivating forces such as sales, produc- 
tion, or firm perpetuation overshadowing maximum profits as 
a motivating force. 

DeMong and Strayer occntend that the drive to 
maximize profits is diluted by the separation oof owner and 
manager. The goals cf the decision making managers may be 
guite diitferent from the goals of the owners. While the 
owners may indeed be more concerned with maximizing their 
return on investment, profit maximization has been replaced 
among the eee ors by "profit satisficing,™ or the desire to 
obtain satisfactory profits. Managers are held accountable 
for more than just prcfits; they are also neld responsible 
for company production, sales, firm perpetuation, employee 
morale, etc. Because managers cannot devote their full time 


Pomp nOLLt Nei mizationy tomthe excluswonwofwall other gqea@is, 
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they are forced to ensure profits reach an acceptably satis- 
factory level, then concentrate on the other competing goals 
[Ref. 78]. 

Pid ep eee Cppedahl has developed a hierarchy of 
needs for a corporation which farallels Maslow's hierarchy 
of individual needs [Ref. 79]. Just as Maslow proposed that 
individuals seek to satisfy the most basic human needs first 
(physioiogical needs, safety and security needs, love and 
belonging needs) and then seek Satisfaction of higher needs 
(esteem, self-actualization, the need to know and under- 
stand, and esthetic needs), Oppfedahl proposes that a corpo- 
ration seeks to satisfy the neetll of survival, Preise, 
growth, market share, and prestige (in that order). 

Survival is the most basic need. Once the need to 
be a "going concern" has been satisfied, the profit motive 
becomes the primary motivator fcr the corporation. However, 
just as DeMong and Strayer discussed the concept of "profit 
satisficing," Oppedahl contends that profit does not always 
equate to profit maximization. Rather, the Concept os 


“adequate profit" suffices as demonstrated by the following: 


In terms of Government contracts, growth is associated 


with more contracts and and larger taryet costs. Note 
that with the profit need satisfied, greater size 
contracts become the driving motive. This will tend to 


explain why some firms will spend to target cost and 
beyond at the expense of a share ratio loss of profit. 
The other aspect of growth, namely technical capability, 
is also very important to a defense contractor. Most 
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DOD contracts are labor intensive and highly technical 
in score. Hignly educated and qualified personnel are 
very important to the growth cf a DOD contractor, tnere- 
fore, sacrificing profit share may be attractive tca 
contractor reiative to maintaining and increasing tech- 
nical competence [{ Ref. 80}. 


While the DOD and NASA Incentive Contracting Guide 
recognizes the profit motive as the "essence of incentive 
contracting," it also recognizes that other extracontractual 
factors can be significant motivators to the Defense 
Comeractor. These factors include growtn, new product 
improvement, prestige, impxrcved public image, social 
approval, national defense goais, potential for follow on 
business, commercial application, excess capacities, 
increased profits oon other contracts through shared over- 
head, and exceiling for the sake of excellence. In addi- 
tion, DOD "recognizes that cecntractors will, generally, 
SpueatzZe,, DOt maximize, sprofit" [Ref. 81]. 

Finally, in his book Arming America: How the U.S. 


Buys Weapons, J. Ronald Fox contends that: 


- 


Profit is not a defense contractor's only concern when 
bidding on or conducting a development or production 
program. Defense contracts are sought to cover payroll 
and overhead costs, and to provide company personnel 
With the opportunity to develop technical and managerial 
Skills useful in commercial and defense business. Once 
a contract 1S won, a company seeks every opportunity to 
add work and funds to the progran. The need for follow 
on work 1s crucial, since (1) the initial effort to 
secure a contract involves a large outlay of money, and 
(2) there is usually a long time lapse between contracts 
for the same weapon system [Ref. 82]. 
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D. CONCLUSION 


So what's tne answer? Ie "profit asa notivatilemal 
tool face Or ele ton: The answer appears to be "a little 
of both." There 1s no clear cut answer to the jguestion. 
While it is clear that profit is not the oniy motivating 
force for Government contractcrs, there are times when 
profit would certainly be the prime motivational tool, such 
aS periods of strong economic growth as discussed earlier. 
in addztzou, it is the researcher's opinion that the DOD 
profit policy evolved into what it is today because itis 
relatively easy for contracting officers to understand; we 
have been so "ingrained with the principles of profit maxin- 
ization that the concept seems almost intuitively obvious." 

It may be more appropriate to think of profit as a 
"“Satisficer" rather than a "mctivator." Contractors gaa 
certainly not perform without a certain profit level. 
However, once that level of profit is achieved, they May not 
increase performance with additional profits alone. 

It is incumbent upon the ccntracting officer to recog- 
nize that these extracontractuai motivating forces do in 
fact exist. The contracting fficer must examine each 
contracting situaticn carefully and attempt to determine 
which factors (in addition to profit) will stimulate and 


motivate the contractor to improve his performance. The 
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proper motivational mechanism must thea be incorporated into 
the contract and the contract properly administered to 
ensure effective results. 

Tt must be remembered that industry's top rated objec- 
tives are to provide a good product and to maintain long 
term continuing business relationships. These objectives 
indicate more concern with long term profit objectives than 
with short term objectives. In the words of one Defense 


contractcr corporate officer, 


They (contractor objectives) are so closely interre- 
lated, itis difficult to rank one above the other or 
clain to have one objective without the other one.... 
We're all in this buSiness to make noney.... SO to Say 
that profit is not a primary objective would be wrong. 
Piet 1S not the only objective.... Of course we want 
to survive and grow. But without a good reputation and 
adequate profits we are out of buSiness. ise OUr, 
company survival, company growth, promoting the compa- 
ny's reputation, and profit are primary opjectives on 
each and every Government contract. No one objective is 
more important than the other [Ref. 83]. 


The theoretical packground and framework Gi CPAF 
contracts have been examined along with those factors and 
influences which motivate a contractor. The next chapter 
will report the results of an examination of various CPAF 
contracts conducted in an attempt to gain insight into the 


award fee determinaticn process. 
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IV. SIRUCTURING AN AWARD FEE 


An evaluation of the award fee determination process in 
CPAF contracts 1s really a two step process. The first step 
involves an examination of pre-award activities and the 
development and structuring cf& contract elements which 
influence the award fee determination process. The second 
step involves contract administration functions in terms of 
evaluation and fee determination procedures. This chapter 
will examine the first step in this process and attempt to 
answer the following questions: 

1. What considerations go into determining the size of 
the base fee? How Large should the base fee be? 

2. How should the award fee, which renains in the award 
fee pool after the fee determination is made, be 
nandled? 

3. What considerations are necessary in formulating the 
evaluation criteria? 

4. How long should the award fee evaiuation period be? 
What criteria should be used in making this 
fe eerie eee 

5. How should the award fee computation formulas be 


developed? What considerations are necessary? 


Wee 


Aw FCRMULATION OF THE BASE FEE 


The FAR limits the size of the base free to three percent 
Ofe, the contract target cost. Mdaet toma lives Chapter ei) 
pointed out that the base fee cculd, in fact, be zero. At 
what level should the base fee fe set? Should the base fee 
be zerc or three percent, or snould it be set somewhere 
between the two limits? 

The CommisSicn on Government Procurement (COGP) in 1972 
concluded that the "overall risks under a CPAF contract were 
at least equal to the risks under a cost-plus-fixed-iee 
(CPFF) contract" [Ref. 84]. It was therefore concluded that 
the base fee of a CPAF contract should be at least equiva- 
lent to that which would be appropriate if the contract were 
CPFF, with the provision for subjective fee adjustments to 
be both upward and downward. The rationale here is that the 
CPAF contract was devised aS an incentive type, with a 
Subjective fee adjustment, to re used when the anticipated 
results were of such a nature that a formalized CPIF sharing 
formula, for both upward and downward adjustments of fee, 
could not be developed. The Ccmmission also concluded that 
"there 1S no particular justification for the CPAF basé fee 
to be inordinately low (three percent maximum) with an award 


fee upward only" [Ref. 85]. 
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A CPAF contract iies between the spectrum of a CPFF 
contract, where the Government assumes 100 percent of the 
Lusk and a firm-fixed-price (FPP) contract, with the 
contractor assuming 100 percent of the risk. Between these 
two types of contracts, tradeoffs occur concerning the "risk 
Sharing ratio." As such, the risks under a CPAF contract 
are not at "ieast equal to those under a CPFF contract". If 
the risks were equal, a CPFF contract should be used rather 
than a CPAF contract. 

If the logic of the Commission on Government Procurement 
were followed, the base fee would be set at seven or eight 
percent. It must always be remembered that one of the 
primary purposes of a CPAF cecntract is to motivate the 
COMP RaerOr. The higher the base fee becomes, the nore the 
contract appears to approach a cost-~plus-fixed-fee contract 
with award fee provisions (CPFF/AF). Additionally, the 
larger the base fee pecomes, the Ssmailer the award fee pool 
must be to comply with the statutory fee limitations 
discussed in Chapter II. To ke a sufficient motivational 
tool, the award fee must be material in amount; large enough 
for the contractor to be incentivized to "achieve the carrot 
at the end of the stick". The smaller the award fee, tne 
the more likely it is that the contractor will lose his 
motivaticn to earn the fee because, as one corporate officer 


put it, "the trouble and expense is not worth the payoff." 
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It would appear logical to establish the base fee at as 
small a level aS possible, at or below three percent. A 
CPAF contract in its true form would nave a zero base fee, 
and maximize the award fee pool to gain the greatest motiva- 
tional leverage over tne contractor. Tne majority of 
Government personnel interviewed indicated that the base fee 
should Le three percent, because it's "authorized in the 
FAR," or "it appears to be the standard; three percent has 
become a way of life." One Acquisition Branch Manager for a 
major Navy project indicated that the size of the base fee 
Should "depend on the complexity of the project. It should 
be flexikle between 1.5 and 5 percent depending on the risk. 
The average is tnree percent and it should be 0 percent only 
with a stable product." He continued that if the product is 
truly stable, a fixed-price type of peer raeeieheuld te used. 
The majority of the contracts examined by the researcher 
contained a base fee of three percent, with only one 
contract having a zero base fee. 

In the researcher's opinion, contracting officers appear 
to have lost sight of the basics. According to Dr. Meiners, 
a noted specialist with CPAF contracts, "tne base fee, when 
originally conceived, waS intended only to cover the 


contractor's unallowable costs, which historically nave been 
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two percent."* In the researcher's opinion, this natura 
assumes that there is a potential for the contractor to earn 
none of the fee available in the award fee pool. Dag. 
Meiners also pointed out that "there 1S no other type of 
contract where funds are set aside specifically to cover 
unallowakle expenses." These expenses are normally covered 
by the standard profit or fee the contractor earns. 

In the researcher's opinion, the use of a base fee is, 
therefore, only for those situations where the Government 
and the contractor are so concerned with and anticipate that 
the contractor may perform so poorly that the contractor 
will earn only the base fee. This would certainly be the 


exception rather than the rule. 


Be. AWARD FEE POOL 


How should funds which remain in the award fee pool, 
after the award fee determinaticn is made, be utilized? The 
answer to this guestion is negotiable and should be resolved 
during the formation of the contract and contract negotia- 
tons. Two options exist to handle the unearned award fee. 
The £farst option is to have that amount not awarded lost as 
far as the contractor is concerned. The second option is 


referred to as a “roll over," where a percentage of that 


4Interview conducted on 26 July 1984 
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award fee which was not earned by the contractor is rolled 
forward to subsequent periods. 

The contracts examined and personnel interviewed were 
equally split regarding the roli over issue. Roughly half 
of the contracts reviewed contained roll over provisions 
ranging from 40 to 80 percent of the unearned award fee. O€£ 
those personnel interviewed, thcse who used roll over provi- 
sions favored their use, while those who did not use roll 
overs feit very strongly against then. 

Recent guidance from the Naval Material Command (NAVMAT) 


ease hat: 


Carry forward provisions for unearned award fees are 
expressly prohibited (emphasis added) Without) soir or 
approval from Chief of Naval Material (CNM). Any 
portion of available award fee not awarded during an 
evaluation period is not transferable to another period 
without CNM approval. [Ref. 17] 


The researcher predicts that the impact of this recent 
poiicy change will be to significantly reduce the use of 
roll over provisions. 

What are the major concerns with the roll over issue? 
To answer this guestion perhaps it may be appropriate to 
examine some of the advantages and disadvantages of roll 


over provisions. 
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Some argue that a roll over provision enhances the 
ability to motivate or incentivize the contractor by making 
the award fee pools in subsequent periods more attractive. 
One Administrative Contracting Cfficer (ACO) indicated that 
the goal is to "incentivize the contractor; if it takes 
fifteen bites (at the apple), sc be it." 

One Business/Financial Manager indicated that a 
"roll over provides a levered fee at the end of contract 
performance." This works particularly well with contractors 
who have multiple contracts. The roll over provision can be 
used aS a tool to protect one project against scme other 
projects. This would be particularly true if those "other 
projects" were not award fee contracts or if award fee 
contracts did not have roll over provisions. 

Another Business/Financial Manager indicated that, 
if a rcll over provision is not used, the tendency is for 
the PEB to inflate the grades given the contractor. There 
may be some truth to this assumption; however, supporting 
evidence could not be found. Alony these same lines, the 
assumption is that if a roll over provision were used, the 
PEB would be more iikely to give honest grades to the 
contractor knowing that the "carrot and stick" effect can be 
retained with the possibility to recover from the loss and 


regain some of the lost award fee in subsequent periods. 
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ema lily, an AcgquiSiticn Branch Manager indicated 
that if the award fee pool were siynificantly small as to 
not motivate the contractor to the degree desired, a roll 
over provision would be desired. This would enhance the 
award fee pool in subseguent periods in the hopes of 


improving the contractor's motivation. 


2. Disadvantages 


Without exception, ail those personnel who did not 
favor use of award fee roll over provisions did so because 
they perceived “the roll over to besea = "gitt to the 
SeomeeactOr” and alitowed the ccntractor "multiple bites at 
the apple". One individual even suggested that loss of the 
unearned award fee was a larger incentive to the contractor. 
The contractor foula theoreticaily maximize efforts during 
each evaluation period knowing that any award fee not earned 
would be lost. 

A second disadvantage of roll over provisions is 
that they tend to create a "row wave" effect by pushing 
problems to a later date with the hope that the lost award 
fee can be regained at a later date. The problem this 
creates is that often the number of unresolved issues 
becomes too large to manage effectively. 

An examination of one contract which did not use a 


roll over provision provides some additional information. 
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TABLE 1 


Examination of Award Fee Without Roll Over Provision 


{ i 
| 
| 
| | 
| | 
| 
| Award Fee Earned Unearned ] 
| Period Pool Ratings Award Fee Award Fee ff 
| 
| 1 SHS O05 55 86% $112 e0cc $18,247 | 
2 86,890 94% So lesa 7 5,2 ie | 
| 3 88,173 95% 83,764 4,409 
| 4 Si Ue 94% 82,634 5, 24 | 
| e So, 25 95% 83,846 4,413 
6 261,640 95% 246751 13, 022 | 
l 
[| TOTAL eh 7e2, 206 $692,567 $50,649 | 
| | 
| 
| rer eee ype a i ue ee es ss 


fable 1 ptovides datavover sear. evaluation periods for the 
OFi gama l Contract. Tabie 2 contains the same data that 
appeared in Table 1 except that it has been modified by the 
researcher to include a 49 percent roll over provision. AS 
can be readily seen when comparing Table 1 with Table 2, the 
roll over provision guickly inflates the award fee pool. If 
not properly planned for, this inflation of the award fee 
pool can lead to what some personnel consider "excessive" 
fees. Table 3 shows the impact on the same data in table 1 
uSing an 80 percent roll over provision. AS can be seen in 
Table 3, an additional $30,000 in award feeS are earned over 
that shown in Table 1 Some of those interviewed consider 


this a needless "give away". 
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———— ~=~—~—SO _ ~ e 
| 
| 
TABLE 2 | 
Fxamination of Award Fee With 40 Percent Roll Over 
| 
Award Fee | 
i Pool With Earned Unearned 
Period 40% Roll Rating Award Fee Award Fee 
| 
] 1 St 30y335 86% p112,088 $18,247 
Z 94,189 94%, Soe 557 SOD 2 | 
3 90,434 95% 85,9 1.2 4,522 | 
| 4 89,718 94% 84,335 boo 3 | 
| 5) 90,412 95% gD, oo2 tee 2 UO | 
| 6 263,448 95% 250.270 35.172 { 
| 
TOTAL So, oO 2/7907, 040 $51,496 
| | 
ac es coeeasel 


3. Summary 


What then is the answer to the roll over issue? ast 
really boils down toa judgement call. AS indicated 
earlier, NAVMAT'‘sS guidance expressly prohibits the use of 
BOLL OVeELr provisions MmEcnOut prLror CNM approval. Tf the 
reader is of the school of thought that the contractor 
should never get another bite at the apple, then clearly 
roll over provisions are never appropriate. 

tieetesedreher 1S Of the Opinion that circumstances 
may exist which favor use of rcll over provisions and this 


option snould be considered. An 80 percent roll over, in 


on 


a 
| | 
| 
| TABLE 3 | 
| | 
Examination of Award Fee With 80 Percent Roll Over | 
l | 
| | 
| Award Fee 
Pool With Earned Unearned jf 
{| Period 80% Roll Rating Award Fee Award Fee | 
| 
1 o130,355 86 % $112,088 $18,247 | 
J 2 101,488 94 & 95,399 6,089 | 
| 3 93,044 95% 83 , S92 4,652 9 
uy 91,631 94% 86 3 3 5,498 | 
| > or, 05 7 95% 88,024 4,633 | 
| 6 205,346 Sis) 252,099 13,267 ee 
| | 
| TORR, $774,501 S722, NS $52 ,stes 
| | 
| 

aa 


the researcher's opinion, is tco high, because it enhances 
the idea held by many that award fees are "give away 
PEOG mac. A 20 percent roll over may be too low to be 
effective. Perhaps a 40 or 60 fercent roll over provision 
May be appropriate. A study to determine the most "cost 
effective" roll over is beyond the scope of this thesis. If 
a roll over is used, consideration must be given tc the 
“Winflationary factor" demonstrated in Tables 1 and 2, some- 
thing which has not received adequate consideration in the 


Pasi. 
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Cne additional observation about the use cf rcll 
over provisions may be appropriate. If the reader is prina- 
fy concerned with cost control, then controlling costs 
through the use of no roll over provision is not the nost 
Pogecal approach. Table 2 shows that the additional award 
fee earned with the use of a 40 percent roll over provision 
was $14,473 ($707,040 minus $692,567), which is less than 
two percent of the original award fee pool. It would seen 
meme more logical tc focus cost control efforts at direct 
labor hours and other areas where the large doliar expendi- 
tures occur. 

Of those contractor representatives interviewed, all 
were in favor of roll over provisions, which should not bea 


surprise. 


C. EVALUATION CRITERIA 


Chapter II identified the evaluation criteria most 
commonly used as the adjective-type standard rating systen 
which indexes a performance quality adjective and ccrre- 
sponding explanation to a percentage of the potential award 
fee available during the evaluation period. Is this really 
the best way to structure the performance ratings? What 
considerations should be used in developing the evaluation 
eEtteria? These and other issuves will be addressed in this 


section. 
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1. Performance Rating 


There are Many rating flans being used today. No 
two systems will be, nor should tney be, identical. The 
system selected must be tailored to the individual, uniyue 
requirements and be that system which best fits the needs. 
However, structuring of the rating plan can lead to ccnfu- 
sion for both the contractor and Government personnel. 
Consider tae following examples, all extracted fron 
different contracts and all representing the highest 
performance rating in the contract: 

1. Superior performance; Represents 80 to 100 percent 
of the potential award fee. The contractor has 
demonstrated an overall levei of performance which 
exceeds the contract requirements. 

2. Superior Performance; Represents 86 to 100 percent 
of the potential award fee. The contractor has 
demonstrated an overall level of performance which 
substantially exceeds the contract requirements. 

3. Superior Performance: hepresents 86 to 100 percent 
orf the potential award fee. The contractor has 
demonstrated an overall level of performance which 
qreatly exceeds the contract requirements. 

4. Excellent: Represents 91 to 100 percent of the 


potential award fee. The contractor's performance 
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greatly exceeds the merely satisfactory level of 
efforts. The evaluator cannot cite relevant areas 


for improvement. 


eee =bxcellent: Represents 91 to 100 percent of the 
potential award fee. The contractor's performance 
exceeds requirements by a substantial Margin. The 


evaluator cannot cite relevant areas for improvement. 

aoe bxcellent: Represents 86 to 100 percent of the 
potential award fee. The contractor's performance 
greatly exceeds the merely satisfactory level of 
performance. The evaluator cannot cite relevant 
areas for improvement. 

fee Outstanding: Represents 386 to 100 percent of the 
potential award fee. The contractor's performance 
exceeds the minimum by a substantial margin,; and the 
monitor can cite some aréa for improvement, most of 
which are minor. 

The first three examples above came from the same 
project office, but were in contracts awarded to three 
different Pome tor =! Thais led to some confuSion within 
the project office. Was "Superior" performance really 80 


percent, or was it 86 percent? In addition, what's the 


difference between "exceeds", "Substantially exceeds", and 
"greatly exceeds"? Furthermore, what's tne difference 
between "Superior performance", "excellent", and 
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"Nouts tandang "2 KFhat does it fnean to “exceed the @inifun 
requirements by a substantial margin"? If a contractor Mia 
"some areas of improvement", 1S his performance truely 
"outstanding"? 

Even the recommended evaluation standards system 
recommended by NASA (discussed in Chapter IT) raises some 
guestions and creates confusion. Consider the following: 

Excellent: Represents 91 to 100 percent of the poten- 
tial award fee. Performance is outstanding in mcst 
respects, approaching the best that could be performed 
by a qualified contractor. Contractor has greatly 
exceeded quality, schedule, output and overall 


performance which would be expected of an average 


contractor. Areas of deficiency are very few and 
relatively unimportant in nature. Contractor shows 
initiative in executing the job and invoking 
improvements. 


In the above example, the adjective rating is "excellent", 
yet the description reads "performance is outstanding in 
most respects." Do "excellent" and "outstanding" mean the 
Same thing? 


The problem appears to be one of symantics. What 


may be "excellent" to one individual may not mean the same 
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to another. In addition, the adjective ratings are rela- 
tive; there do not exist any standards witn which to rate or 
compare one "excellent" rating with another. 
Still another area for confusion is the number of 
rating categories. Consider the following examples: 
1. Contract Number 1 
a) Superior Performance: 80 to 100 percent. 
b) Satisfactory Performance: 50 to 80 percent. 
c) Marginal Performance: 20 to 50 percent. 
d) Unsatisfactory Performance: 0 percent. 
2. Contract Number 2 
a) Excellent: 91 to 100 percent. 
b) Good: 66 to 90 percent. 
c) Satisfactory: 41 to 65 percent. 
d) Marginal: 21 to 40 percent. 
e) Unsatisfactory: 20 percent and Below. 
Beecontract Number 3 
a) Outstanding: 86 to 100 percent. 
Db) Excelient: 75 to 85 fercent. 
Cc) Good: 65 to 74 percent. 
d) Acceptable: 50 to 64 percent. 
€) Marginal: 30 to 49 percent. 
£) Hinimal: 0 to 29 percent. 
In Contract Number 1 of the above examples, 1s an 80 percent 


eeolcre "satisfactory" cr “"supericr"? Are 51 and 79 percent 
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scores 1n Contract Number 1 Ecth “satisfactory? (JAS the 
number of rating categories are increased from four in 
Contract Number 1 to six in Contract Number 3, this confu- 
sion is reduced. The greater the number of rating 
categories and the more specific each category 1s, the less 
confusion tnere is likely to be. 
if it 1s necessary to use a combination of adjective 

and numeric ratings, the researcher sugyests that the 
percentages assigned to each category are fiexible and may 
be adjusted. In addition, each category may be further 
bkroken down into "plus" and "minus" ratings. For example, 
the "Good" category in Contract Number 3 above may be subdi- 
vided as follows: 

Gooa Plus: 72 to 74 percent. 

Good: 68 to 70 percent. 

Good Minus: 65 to 67 percent. 
The particular structure chosen 1s strictly up to the 
creativity of the Contracting Officer. 

The performance rating exists only for the cenefit 

Oofv the cchemaceor, The ratings give the contractor some- 
thing with which to relate the numerical grades. In the 
researcher's opinion, this can be accomplished with the 
criteria description just as well as with an adjective 
Ta baie By eliminating the adjective rating and relying 


strictly on the numerical rating, some of the confusion Gar 
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be reduced and the contractor can decide whether an 89% is 


Nexcellent™" or “outstanding". 


It is possible to improve on the rating frlans 


currently being used by eliminating the adjective descrip- 


tions and increasing the number of rating categories. Such 


an example would be as follows: [Ref. 87] 


ee 


Represents 971 to 100 percent of the potential award 
tee. The contractor's performance exceeds regquire- 
ments by a substantial margin. The evaluator cannot 
cite relevant areas for improvement. 

Represents 83 to 90 percent of the potential award 
fee. The contractor exceeds in overall performance 
reguirenents. The evaiuator may cite one or more 
areas for improvement but they are relatively minor 
in terms of potential frogram impact and they are 
substantially offset by better performance in other 
areas, 

Represents 75 to 82 percent of the potential award 
fee. The contractor's performance meets all require- 
ments. . The performance 1S neither Significantly 
Superior nor significantly inferior. Areas of risk 
are of no greater degree than would ordinarily be 
expected in the performance of a typical contract of 


this size and complexity. 
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Represents 67 to 74 percent of the potential award 
fee. The “Centrde vor performance is adequate 
although the evaluator may cite several areas for 
improvement, these are cffset by better performance 
in other areas beiny evaluated and dericiencies are 
of a minor nature. This level of achievement would 
be the norm for contractors completing jobs and the 
contract on schedule with reasonable quality and 
COSt. 

Represents 50 to 66 percent of the potential award 
fee. The contractor's performance fails to meet all 
requirements. There are areas of good or better 
performance but these are offset by lower rated 


performance in other areas. 


Represents 31 to 49 percent £ the potential award 
fee. The content and quality of the contraetom 
performance are close to being adequate, although 


there are many areas for improvement. No major defi- 
ciencies are cited. 

Represents 0 to 30 percent of the potential award 
fee. The content and guality of contractor penpiera. 
ance in at least one area are deemed by the evaluator 
tc need substantial improvement. Contractor perfora- 
ance in the area being evaluated is considered to be 


such that a fotentially adverse impact is fcreseen. 
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The need for improvement iS such that Government 
action may be required. 
It should be noted that as the number or categories is 
increased, the number of rkorderiine comparisons also 
increase. If the number of categories is too large, it then 
becomes a problem of being able to differentiate between 74 


or 75 percent adequately. 
2. Performance Evaluation Criteria 


Structuring the performance evaltation criteria is 
the heart of the award fee process. Criteria must Ee selec- 
tiveiy identified which, when implemented, will truely moti- 
vate the contractor. A number of the interviewees felt 
strongly that the development of standardized evaluation 
criteria should not be recommended. The Program Manager and 
Contracting Officer must maintain flexibility to again 
structure the criteria to the individual Someta C1icn. 
Standardized evaluation criteria would reduce the Program 
Manager's flexibility to manage. 

Those ‘wiitietliea.1s who draft the evaluation criteria 
must tailor the criteria to the individual contract. As one 
Business/Financial Manager indicated, the first step in this 
process is to gain an understanding of the environment 
unigue to the individual contractor. This may likely 


reguire a visit to the contractor's plant and interviews 
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With key individuals. There are some things which the 


contractor may be highly motivated to perform without the 


Government having to incentivize the contractor. As 
discussed in Chapter III, sche of these considerations 
include “extracontractual Dot vations cua as company 


growth, an increased share of the industry market, a petter 
public image, Carry-over benefits to commercial business, 
greater opportunity for follow on business, and greater 
Shareholder expectations for future growth and profit. In 
addition, the Government does nct want to apply motivational 
forces to a contractor for those things which the contractor 
already does well. The Government must consider the 
contractor's individual strengths and weaknesses and only 
incentivize the weaknesses. Hcwever, the Government should 
be ready to incentivize areas which might now be strengths 
Fut become weaknesses at a later date. 

A second concern is the number of evaluation 
criteria to be used. One Program Manager indicated that if 
"you incentivize everything, you end up incentivizing 
DON Gea The contractor cannot be overburdened with so 
many different criteria upon which to focus management 
talent that the contractor becomes demotivated. As several 
interviewees indicated, there are generally three major 
categories to structure evaluation criteria around. The 


Crime ri anaes 
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1. Technical Performance 

2. Scnedule 

Be Cost Control 
A fourth category of "Management Performance" is often iden- 
tified as a separate category cris combined with Technical 
Performance. Still a fifth category periodically used is 
Bijesign to Cost". The consensus of opinion from those 
interviewed is that the number cf categories used for evalu- 
ation criteria should be limited to three or four at the 
maximum. The researcher belié€ves that too many eiements 
will dilute ee motivational effect of the award fee 
concept, while too few elements will fail to adequately 
measure total contractor performance. 

The verceived problems from interviewees with evalu- 
ation criteria currently being used are that they are ade 
weighted properly nor are they well quantified. Evaluation 
criteria which are not well quantified leave too much roon 
for interpretation, and some individuals feel it leaves too 
much room for subjectivity. For example, the evaluation 
criteria in one multi-million dollar contract examined are 
as follows: 

1. Technical Performance: The contractor shall te eval- 
uated as a System Prime Contractor (SPC) under this 
contract based on achievement and conformance to the 


Specirication. This shall include the evaluation of 
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tne contractor's performance or all design, tabi 
hon reliability and Maintainaciers software, 
integrated logistics supfort, system interface tests, 
system integration, services, and system demonstra- 
tions. The assessment cr SPC performance will also 
be evaluated against lower indentured Specifications 
and the contractor's achievement of technical objec- 
tives cited in management plans. 

Management: 

a) The award payments for this area shall be basea on 
the coatractor's achievements in Management. 

b) The criteria to be utilized in determining manage- 
ment performance will iaclude the effectiveness of 
the contractor's management, working in assccia- 
tion with the Navy, to achieve an operational 
systen. This includes the management of inter- 
faces with various Navy activities and Government 
Furnished Equipment (GFE) suppliers. The specific 


areas to be reviewed include the following: 
1. Management of GFE; 
2. Relationships with associate contractors; 


3. Configuration management; 
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a Effectiveness of forecasting potential prob- 
lems and a suggested resolution to mininize 


PROognbam Lmpact; and 


Die Compliance with Interface Control Documents 


(ICD) . 


is Schedule: 


a) 


b) 


The award payments for this area shall be based on 
the contractor's achievements in providing the 
necessary management controls and assets to accon- 
plish the delivery of data, hardware, scftware, 
training, Maintenance, Support items and the 
assistance to the Navy in in maintaining total 
program schedules. 

The award fee evaluation relative to delivery 
Skait Consist of a review of the foilowing 


Crieeria: 


le Delivery of all contract data requirements in 
accordance with the contract Data Requirements 


= 


List. 


Z Achievement of scheduled design, fabrication, 
tests, system integration, and demonstration nile- 


Stones (within the projected program schedule). 


J 


S. Recognition of fotential delivery problems, 
recommendations as tc resolution and successful 
attainment of agreed upon methods of resolution to 
Minimize program impact. 

1... “Gost: The award payment for the area shall be based 
on the contractor's ability to manage the costs on 
the Fuil Scale Development Program including cost 
reports and the ability to implement cost avoidance 
measures. 

5. Design to Cost: The award payments under this area 
Shall be based upon the contractor's achievement of 
the objectives of the Design to Cost Plan. 

Much of the criticism concerning CPAF contracts 
today stems from the belier by many that the determination 
of multi-million dollar award fees is too subjective. The 
evaluation criteria when not well-defined, as in the example 
above, highlights just how subjective this determination can 
be. This criticism can be reduced by better defining the 
evaluaticn criteria and lending a degree of objectivity to 
the evaluation, or at least becoming less subjective. An 
example of better defined evaluation criteria will be given 
at the end of this ’sectron- 

The Government has the ability in the contract to 
shift evaluation criteria weights from one period to the 


next. It is the general feeling among those interviewed 
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that this flexibility 1s not being utilized to the naxinun 
,extent possible by those using CPAF contracts. In the 
Concept Exploration phase of a system's deveiopment, tech- 
NRical performance may be the most important evaluation 
ee and should ke weighted high, perhaps 50 percent. 
schedule rerformance and cost ccntrol may he less important 
and management performance may be so unimportant as to be 
weighted at 0 percent. However, as the product moves into 
producticn, management performance becomes more important as 
the transition is made from development to production. oot 
must be ker ca to change the weightings to reflect the 
changing conditions. The problem with shifting the evalua- 
tion criteria weights are first to determine how the weights 
are to ke shifted, and secondly, to make the decision and 
inform the contractor in a timely manner to allow the 
contractor time to respond and make the necessary adjust- 
Ments within the organization prior to the start of the 
evaluation period. Mics) soeonten difficulr to aceonplish 
and as one Business/Financial Manager pointed out, this 
flexibility is often not utiiized by the Program Office. 
> As one senior manager who formulates policy indi- 
cated, cost control is always of major concern. Some of the 
criticism of CPAF contracts in recent months has arisen fron 
the concern that cost control has not received enough atten- 


tion and weight in the evaluaticn criteria. The suggestion 


Sa 


waS Made by the researcher that guidance be promulgated 
"highly recommendiny" that cost control be given consider- 
able weight relative to the other evaluation criteria. 
Without exception, all those interviewed strongly felt that 
this was not proper. The Program Manager must’ be able to 
remain flexible in order to tailor the criteria to the situ- 
ation. However, the consensus was that cost control should 
always be an evaiuation element. NAVMAT also requires that 
cost control always Fe included as one of the evaluation 
criteria [Ref. 17]. 

If it 1s not desired to standardize the weight given 
to cost control, perhaps it May be appropriate to iGenuaey 
evaluaticn criteria which should be recommended for use. [It 
is interesting to note that guidance does not exist which 
even identifies the evaluation criteria which must be used 
fonecost. conte. This flexitility also rests with those 
who tailor the criteria to the unidue situation. 

Another idea was suggesteac that a mathematical model 
be developed which would identify the weighting to be 
applied to cost control. The development of such a nodéel is 
beyond the scope of this thesis. However, some thoughts on 
the subject are appropriate. There is some value to giving 
cost more weight (1i.e., 30 to 4G percent) because it demon- 
strates to the contractor that costs are of interest. In 


the researcher's opinion, the danger lies in that the 
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contractor may then decrease management attention on tech- 


nical performance or the schedule effort. As Dr. Meiners 
pommrea Out “cost 1S a function of cost." Cost would not be 
an independent variable in any mathematical nodel. Bocteas 


dependent on both schedule and technical requirements. 
Costs may ke better controlled by placing more emphasis on 
schedule. As the schedule imprcves, lower costs will gener- 
ally result from reduced direct labor hours and overhead 
charges. Work generally appears to expand by tne amount of 
funds the Government has. thee Longer the contract As ean 
place, the higher the costs tend to be.§ 

While the FAR is specific in requiring the inclusion 
of the evaluation criteria in the scealtiaiaia it “dees net 
indicate that it is mandatory that these criteria be negoti- 
ated with the contractor. The researcher can see advantages 
to not negotiating the evaluaticn criteria. However, if the 
contractor's fee is dependent upon how well the evaluation 
criteria is written and understcod, it is evident that the 
Cont racther would have a vested interest in the development 
of the criteria. As such, the contractor should, asa 
Minimum, be authorized to provide some input into the devel- 


opment of the evaluation criteria. 


se cee i ec 


Stervrew Conducted with Dr. Arthur C. Meiners, Jr., on 
26 July 1984. 
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It was the consensus from. those interviewed that 


there is no cookbook solution to the formulation of evalua- 


EVOnwer Trcimlas Each set of criteria must be individually 
tailored to the unigue situation. However, it 1S afpro- 
priate to examine major ccnsiderations to use when 


formulating well-defined evaluation criteria. These consid- 
erations are provided in Appendix D for review. Appendix D 


identifies three evaluation criteria which are reccnmmended 


for use by the researcher. These criteria are technical/ 
Management performance, schedule periormance, and ‘“@@atr 
performance. In addition to these criteria, major areas of 


consideration are identified for each of the three Criteria, 
which could be modified for any of the eighteen contracts 
reviewed. The more detailed the evaluation criteria, the 
easier it becomes to be somewhat objective ina process 
which 1s inherently subjective. The less subjectivity 
involved with the award fee determination process, the less 
there will be criticisn. This subjectivity can be reduced, 
in the researcher's opinion, fy increasing the number and 
detail of elements when evaluating performance in each 
criteria. 

If a fourth evaluation element is to be used, it 
should be logistics supportability, Trecognizing 1itegmaaes 
logistics support equal in importance to cost, schedule, and 


technical performance. Although previously not used to 
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evaluate contractor performance, ioyistics supportability is 
receiving increased attention and visibility. Where appro- 
priate, major considerations in structuring evaluation 
@erecria for logistics supportarility include: [Ref. 88] 

1. Maintenance Planning: The contractor should partici- 
pate in the process to evolve and establish nmainte- 
hance concepts and requirements for the lifetime of a 
material system, and this participation should be 
evaluated. 

Pemeoupply Support: All management actions, procedures, 
and techniques used to determine requirements to 
acquire, catalcg, receive, store, transfer, issue, 
and dispose of secondary items should be evaluated. 
This includes provisioning for initial support as 
well as replenishment supply support. 

SeeouPpKOLt Bquipment: The contractor should participate 
and be evaluated in the identification and acquisi- 
tion of all equipment (mcbile or fixed) required to 
Support the operation and maintenance of the material 
system. This includes associated multiuse end items, 
ground handling and maintenance equipment, tools, 
calibration eguipment, test equipment, and automatic 
test eguipment. 

4. meemnical Dart ai; The contractor should be evaluated 


on the completeness, accuracy, and timeliness of 


- 
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technical data provided to support the system. Ths 
includes recorded information regardless of form or 
character (Such as manuals and drawings) of a scien- 
tific’or techiecairawcdac: Computer programs and 
related software are not technical data; however, 
documentation cf computer programs and related soft- 
ware are. Also excluded is financial data and other 
information related to ccntract administration. 

Packaging, Handling, Storage and Transportation: The 
contractor should be evaluated on the resources, 
processes, procedures, design considerations, and 
methods utilized to ensure that all system equifment, 
and support items are preserved, packaged, handled, 
and transported properly, including environmental 


considerations, equipmert preservation requirements 


for short and Long term storage, and 
transportability. 
Design Interface: The relationship of logistics 


related design parameters, such as reliability and 


maintainability, readiness, availability, and sufport 


resource requirements should be evaluated. These 
logistics-related design parameters should be 
expressed in Operational terms rather than as 


inherent values and specifically relate to system 
readiness objectives and support costs of the 


material systen. 
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3. Summary 


? 


In summary, the development of the evaluation 
criteria cannot be accomplished ina vacuun. An evaluation 
of the contractor's strengths and weaknesses must be 
completed, with the weaknesses highlighted in the evaluation 


criteria. 


D. EVALUATION PERIOD LENGTH 


The Naval Material Command (NAVMAT) specifies that 
generally, each performance evaluation period will not be 
greater than three montns [Ref. 89]. How long should the 
award fee evaluation period be? What criteria should be 


used in making this determinaticn? These criteria have yet 


to be formalized and published as guidance. 


les etermination Criteri 


Before it is possible tc answer the first guestion, 
it 1s necessary to examine the criteria used in selecting 
the length of the evaluation period. These elements, as 
identified in several interviews, in no particular order of 
importance, are: 

1. Projected length of the contract; 
Z.  Comtract Sampaio ews 


3. Size of the contract; and 
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4. Administrative reguirenents. 
a. projected Length of tae Contract 


The estimated length of contract performance is 
one of the key elements in selecting length of the evalua- 
tion periods. If a contract is expected to run for hine 
months, such as in the overhaul of surface combatant ships, 
then three month evaluation periods are almost mandated in 
the researcher's opinion. This gives the Project Officer 
three data pointS with which tc evaluate cost and perforn- 
ance trends, as well as provides flexibility to twice adjust 
evaluaticn criteria weightings, if necessary, t0oO FeGdiiteas 
tne contractor's efforts. On the other hand, in the case of 
a contract which is expected to last longer (i.e., 18 to 36 
months), it may be appropriate to extend the interval of 


evaluation periods to perhaps fcur, six, or hine months. 
k. Contract Compiexir ry 


As one BusSiness/Financial Manager indicated, in 
a complex contract with many events and key milestones 
OCCUELIN GE gulch, the longer the wait between evaluation 
periods, the increased probability that critical problen 
areas will not be highlighted and brought to management's 
attention ina timely manner. If there are delays or 


Significant problems which go undetected, this will result 
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in a bow wave effect and impact subseguent events in future 
periods. 

As another Business/Financial Manager indicated, 
another consideration is that events which nappened more 
recently and are fresh in the minds of performance evalua- 
tors will tend to bias the evaluation. This appears to ke 
true for all evaluation periods of considerable duration 
(l1.e., Six months or more), Dut is particulariy evident with 
more complex programs. This problem may be reduced by 
shortening the length of the evaiuation period to three or 
four months. The researcher suggests that a creative CPAF 
contract may have variable length evaluation periods if the 
amount of work to be done in some commen is less than in 
others. Such a situation may occur in a researcn and dével- 
opment contract when the initial effort is small compared to 


other periods. 
c. Size of the Contract 


The general rule of thumb appears to be, ftron 
those interviewed, that the larger the size of the contract, 
in terms of target cost and award fee pool dollars, the 
shorter the evaluaticn period should be. This thought stems 
from the fact that the Programr Managers are custodians of 
public funds and the belief by many that CPAF Leal aan are 


really "give away" programs. The more frequentlv the PEB 


105 


meets and the FDO provides feegback tovthe contractor; geass 
better "upper management" and tne "watchdogs" feel about the 
job being performed because it appears that the Prcgraa 


Manager iS maintaining tight cortrol over the project. 


d. Administrative Requirements 


Most interviewees fcr this study were in agree- 
ment that CPAF contracts are the most difficult contracts to 
administer because of the increased administrative burden in 
terms of manhours reguired to monitor performance, gather 


the PEB together for deliberaticns, and to publish the FDO 


findings. One individual even went as far as to say that 
“award fees double the ccemplexity of administering 
COME Tact sm" 


The award fee provisions force Government repre- 
sentatives and managers to pay closer attention to the 
contractor and understand both the contractor's actions as 
well as the contractor's strengths and weaknesses. There is 
not much room for doubt on the part of Government represen- 
tatives. Government managers must be sure of their fosi- 
tions, more so than with any other type of contract. AS one 
Cost Analyst indicated, unigue features of CPAF contracts 
require that Government personnel spend nore time in admin- 


istering CPAF contracts. 
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The time Spent in monitoring performance cannot 
re reduced. However, the time spent in preparing testinony 
for the PEB, the PEB deliberations, and acministrative 
requirements of the FDO can te reduced by extending the 
evaluation periods. 

Still another problem of short (i.e., three 
months) evaluation periods is timely feedback to the 
contractor early enough to modify the contractor's perforn- 
ance in subsequent periods. NAVMAT'S guidance is that the 
Award Fee Board (PEB) shall meet as "reasonably close to the 
end of an award fee period as possible" [Ref—. 90}. ff 
reality, this means two to three weeks (10 to 15 working 
days) aiter the end of the evaluation period. The following 
seguence of events was extracted from one contract reviewed, 
and is typical of most contracts: 

1. Within fifteen (15) days from the receipt of testi- 
mony and input to the PEB, the Board shall prepare 
the performance evaluaticn and present it to the FDO. 

2. Within five (5) days from receipt of that evaluation, 
the FDO shall submit to the Contracting Officer his 
determination of award fee. 

3. Within five (5) days frem receipt of that determina- 
alOn, the Ccntracting Officer shall amotify the 


contractor in writing of the FDO's determination. 
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u. Within five (5) days frem receipt of the Contraceammg 
Officer's notification, the contractor may Submits 
the Contracting Officer any exception with respect 
thereto. In support of his reclama, the contractor 
may furnish a written description of his performance 
during the period under consideration. This descrip- 
tion snall clearly identify specific evaluation 
categories, factors, elements, and the contractor's 
own rating thereotr. 

5. Within five (5) days from receipt of the contractor's 
reclama, the Contracting Officer shall submit it to 
the FDO. 

6. Within ten (10) days frem receipt thereof, the FDO 
Shall provide to the Contracting Officer a final 
performance evaluation (underline provided by 
researcher) and determination of the award fee. 

7. Within five (5) days from receipt of the final deter- 
Mination, the Contracting Officer shail NOtiI Gm 
contractor in writing of that final determinati#om 

8. Within five (5) days frem the date of this notifica- 
tion, the Contracting Officer shall issue a Uiaeee 
eral modification to the contract to provide for the 
award fee. 

If the above sequence of events were followed, 


the contractor would not receive formal written notification 
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of the FDO's final performance evaluation until 50 days 
Sowing the deliberations of tne PE8. This is clearly too 
late to modify the contractor's performance in a three month 
(90 day) evaluation period; With over 50 percent of the 
subseguent period past, the contractor would not be given an 
opportunity to modify performance in response to the iast 
performance evaluation and any shifting of weights for the 
evaluaticn criteria. It can be argued that the contractor 
knows well in advance of the FDC's final performance evalua- 
tion where improvements are needed through informal lines of 
communications. a emeer if the FDO's final evaluation uoes 
hot agree with the informal cchmunication, then neediess 
energy and resources have been expended and the contractor 
May in fact become denotivated. 

Even if the contractor is informed of the FDO's 
determinations at the conclusicn of the PEB deliberations, 
15 to 20 percent of the next evaluation period could have 
expired if the PEB deliberations were lengtay or the PEB met 
mo the third week of the new period. 

In the researcher's opinion, one solution to 
this problem appears to be to have the PEB meet during the 
dast ten working days of the evaluation period and encourage 
the FDO to be a member of the FEB. The FDO should then be 
ao a position, after hearing ali the testimony, to provide 


the contractor with a "preliminary" determination in terms 
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of what areas the cecntractor should focus his attention on 
in the following period. Some FDOS may be reluctant to 
provide a "preliminary" determination. However, if the 
contractor accepts the preliminary determination aS just 
that, and recognizes that it is not binding on the FDO, this 


reluctance should not be a problem for the FDO. 


2. Determining the Evaluation Period Length 


What then is the answer to the question "how long 
Should the award fee evaluation period be"? There is no 
cookbook solution. The Program Manager must retain flexi- 


bility in this determination and reach a decision after 
evaluating all the "pros" and "cons", The majority of 
Opinion from those interviewed favor the three month, or 
quarterly, evaluation period. One Business/Financial 
Manager srererred to as the "QPR effect" (or QUuantenuia 


Performance Review): 


Things happen just frior to the QPR.... Correspondence 
is responded to.... Performance improves.... Physical 
actions take place.... Modules get moved.... Prcblems 


get resolived.... The QPR effect results in action. 


E. FEE COMPUTATION FORMULAS 


How Should the award fee be computed? Three different 
methods were utilized in the various contracts reviewed and 
will be discussed in this secticn. 

The first method is Similar to that which is reccmmended 
in the FAR (See Appendix C for review). This method calls 
for each evaluation category to be multiplied by the appro- 
priate rating percentage. This earned percentage for eaca 
category is then totaled. This factor is again multiflied 
py the amount available in the award fee pool to determine 
the earned award fee amount for that evaluation period. - A 
the researcher's opinion, the one weakness in this method is 
Pmeeeene Centractor is rewarded for unsatisfactory ferfornm- 
ance through the award of some amount of fee, although iis 
award fee may be small in amount. 

The second method observed in one program Office is 
guite complicated and involves numerous nathematical deriva- 
trons. Prior to discussing the formula for the award fee 
determination, some definitions and supporting formulas must 
be clarified: 

1. The Quarterly Award Fee Fool (QAFP) consists or the 
Summation of a Primary Award Fee Pool (PAFP) anda 


keallocated Award Fee Pocl (RAFP). 


2. The PAF? available during any evaluation period shall 
be derived by determining the progress made by the 
contractor during the evaluation period. The pi@ge 
ress shall be determined by dividing the cumulative 
Budgeted Cost of Work Performed (BCWP)® to date by 
the total Budgeted Ccst at Completion (BCC) 7 
including Reserves, as they appear on the Cost 
Performance Report (CPR). This percentage will then 
be applied to the contract Total Award Fee Pool 
(TAFP). The TAFP is defined as the sum of the base 
fee and award fee. Fron this total will be 
subtracted the sum of the PAFP pools that were avail- 
able through the previous evaluation period to deter- 
mine the PAFP availakle for the period tleing 
evaluated. 

3. RAFP: Of the unawarded CAFP during any period, forty 
percent wiil be reallocated to the remaining pcertion 


o£ the —-Gontrace- Each quarter a portion of this 


6Budgeted Cost of Work Performed (BCWP) is defined as 
the budget applicable to the work actually accomplished. 
BCHP is determined by adding up the budgets of those work 
packages which have been completed along with an estimated 
amount of budget for the completed work in open work 
packages. 


7Budgeted Cost at Completion (BCC) can be defined as the 
budget applicable to the work scheduled to be accomplished 
within a given time frame. BCC is determined by adding up 
the budgets applicable to work packages scheduled to be 
accomplished. 


amount less the sum of all RAFPs from previous guar- 
ters will be allocated based on the progress nade 
during the guarter compared to work remaining in the 
GOntract: 

When the QAFP and PAFP have been computed, the award fee 
to be paid to the contractor fcr any period can be computed 
by multiplying the QAF?P by a factor (Fn) and subtracting 
O20 ofthe PAFP. The Fn 1s set by the FDO based on the 
evaluation of the contractor's performance by the PEB. cn 
no case will the award fee be less than zero. 

The cia example of award fee determination was 
extracted from a contract with a three percent base fee and 
a forty percent roll cver provision for unearned award fee. 
The subtraction of 0.20 of the PAFP in the above paragraph 
was meant to offset the effects of the base fee. The same 
effect could have been achieved by reducing the size of the 
base fee to something between zero and one percent. in the 
researcher's opinion, the weakness in the above approach is 
that it is cumbersome and time consuming; all the records 
and formula computations were maintained by hand ona single 
data sheet. In addition, the process could also be 
confusing to both the contractor and sovernment representa- 
tives, raising questicns in some individual's minds. 

The third, and most popular, method observed for deter- 


Mining the amount of award fee used a basic formula which 


its 


the researcher has modified into a generic matnematical 


formula. This formuia can be expressed as: 


(Rating - A)/ B x 100 = Award Fee Percentage (4.1) 


In equation 4.1 the "A" represents that maximum threshold 
which is considered to be unsatisfactory performance; 
whether it be 20, 30, or 40 percent. The "B" is simply 100 
Minus "A" so that 1z "A" were 20 percent, "B" would eygual 80 
percent. 

It is easy to understand why this last method is the 
most popular. It is relatively easy to understand, leaves 
iittle room for confusion, and does not award the contractor 
for unsatisfactory performance. If a performance rating of 
30 percent or below were deemed unsatisfactory, the 
contractor would simply not be entitled to any award fee for 


a rating of 30 percent or below. 


Fe. CONCLUSION 


This chapter examined pre-award activities and the 
development and structuring cf contract elements which 
influence the award fee determiration process. In examining 
the determination of the base fee, it was discovered that 


when originally conceived, the tase fee was intended only to 
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cover the contractor's unaliowakle costs. Unaliowable costs 
are normally covered by the standard profit or fee _ the 
contractor earns. Therefore, any base fee which is above 
zero Should be the exception rather than the rule and should 
be used only for those Situaticns where the Government and 
the contractor are sc concerned with, and anticipate that 
the contractor may perform so poorly that the contractor 
will earn only the base fee. 

Funds which remain in the award fee pool, after the 
award fee determinaticn is made, can be handled in one of 
two ways. These funds can either be "lost" as far as the 
contractor 1s concerned, or a percentage of that award fee 
which was not earned by the contractor can be rolled forward 
to subseguent periods. Advantages and disadvantages of each 
option were examined. 

The development of the evaluation criteria cannot be 
accomplished in a vacuum. An evaluation of the contractor's 
strengths and weaknesses must be completed, with the weak- 
nesses highlighted in the evaluation criteria. The four 
criteria recommended by the researcher were technical/ 
Management performance, schedule performance, cost perforn- 
amee, ama logistics supportability. Major considerations in 
developing the evaluation criteria were also reviewed and 


examined. 


VateS 


In-discussing the length ofthe evaluatyon period, Geuws 
elements where identified which must be examined pricr to 
determining now long the evaluation period should be. ‘These 
four elements are projected length of the contract, contract 
COUpLexT ty, size of “the contrac, and administrative 
requirements. The majority of those interviewed favor the 
three month, or quarterly, evaluation period. 

Finally, three methods were identified with which the 
award fee could be ccmputed. The third method, represented 
in equation 4.1, is recommended by the researcher. 

The next chapter examines those functions involved with 
administering CPAF contractS and activities which impact on 
the award fee determination frocess. The chapter will 
conclude with a section dedicated to data/trend analysis of 


award fees in those CPAF contractS reviewed. 


A- INTRODUCTION 


Now that the pre-award contract award fee considerations 
have been reviewed, it iS approfriate to discuss those fost- 
award (or contract administraticn) functions and activities 
which impact on the award fee determination process. These 
functions include the Performance Evaluation Board comfosi- 
ore a rd proceedings and _ the awerorpiay of the Fee 
Determination Official. The chapter will conclude witha 
section dedicated to data/trend analysis of award fees in 


tnaose CPAF contracts reviewed. 


Be PERFORMANCE EVALUATION BOARD COMPOSITION AND PROCEEDINGS 


It is f£1rst afprfropriate to discuss the Performance 
Evaluation Board's (PEB) composition prior to discussing the 
proceedings of the toard. Who sits in on the board's 
proceedings? Who should be represented on the board? These 
and other questions will be addressed inthe next few 


paragraphs. 


Naval Material Command guidance on the composition 


of the PEB is clear [Ref. 91]. 


Award fee contracts shall include a provision for abn 
Award Fee Board (AFB) whose frimary function will be to 
recommend to the FDO an award fee for each award fee 
performance period. The recommendation will be stated 
in terms of a percentage to be applied to the award pool 
for the period being evaluated. Members of the AFB 
Shall be designated by functional job title and shall 
include representatives of various disciplines having 
Significant association with the work being performed, 
i.<eo, Engineering, Quality Assurance, Finance, 
Production, Contracting, Test and Trials, etc. Up to 
25% of the AFB may be comprised of personnel who are not 
associated witao the contract effort involved. The FDO 
may be a member of the board, in which instance the FDO 
Will be the chairperson. 


It 1s interesting to note that while the NAVMAT 
guidance authorizes up to 25 percent of the PEB to be 
composed of personnel who are not associated with the 
CONtReCt@EerZOrt, it does not reguire the PEB to have 
Government representation from the contractor's on-site 
orifice. In one contract reviewed, the PEB was composed of: 

1. The Contracting Officer or his appointed Government 
representative; 

2. Six technical representatives from the Naval Air 
Systems Command; 


3. Three representatives of the Program Office; 
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YW. Two technical representatives of the Naval Sea 
Systems Command; and 
5. One representative of the Naval Electronics Systems 
Ccmmand. 

The researcher finds it difficult to understand how the FDO 
can receive a fair and equitarle evaluation from the PEB 
without having on-Site representation! With the excertion 
of one of the eignteen contracts reviewed, ail the other 
contracts had on-site representation on the PEB, and all 
personnel interviewed, with the one exception, agreed that 
PEB on-site representation is critical to the success of the 
program. A representative of the one contract which did not 
have on-site representation cited "Program Manager's judge- 
ment" as the reason for the lack of well-balanced represen- 
tation. AS one PusineSS/Financiai Manager indicated, 
"Non-site representation reduces needless criticism and frob- 
lems for the PEB." While nearly everyone agreed that 
on-site representation was necessary, it was not clear as to 
the positions and backgrounds these representatives should 
have. Some advocated tnat it was only necessary to have the 
head of the on-site office as a member of the PEB; while 
others advocated more baianced representation in terms of 
Specialty areas (Quality Control, Production, Finance, 


etcs). 


Generally, all members cf the PEB are professionally 
competent senior Government managers. One contract Welt 


Tar as to specify the composition of tne PEB by subdividing 


the board into voting and hon-voting members. The seven 
voting members consisted Ci the Program Manager, 
Administrative Contracting Officer, a customer representa- 


tive and members from both the Systems Command and on-site 
office. Non-voting members were to be assigned by the 
Chairperson (Program Manager) of the PEB to assist in the 
proceedings and could consist of: 

1. An evaluation coordinator who handles all administra- 
tive actions for the PEB meeting to include: setting 
up the meeting, assembling category representative 
reports and other pertinent information for koard 
members, serving as the point of contact with the 
contractor and preparing a draft performance evaiua- 
tion letter to the FDO fcr the PEB. 

2. The recorder Who prefareS minutes of the PEB 
meetings. 

3. Category representatives who analyze monitor reports 
and present findings to the PEB. 


4. Legal counsel (if desired by the Chairperson). 


The researcher can see advantages (and no real disadvan- 


tages) to including ncn-voting members on the PEB. It would 
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certainly expedite the proceedings and provide clarification 


where needed without having to adjourn the meeting. 
2. Proceedings 


Naval Material Command guidance oon the PEB proceed- 


ings are somewhat general [Ref. 92]. 


(1) The PEB shall meet as reasonably close to the end of 


an award fee period as possitie. Timely determination 
of award fees is one of the upmost importance in making 
the award process work. The board shall receive 


reports, both oral and written, as considered necessary, 
from all interested parties. A report will be presented 
Py the contractor. The PEE is encouraged (emphasis 


added) to invite contractors to be present during the 
presentation of these reports. 


(2) At the conclusion of the PEB meeting, the board 
shall, in closed session, derive a rinal overall score 
by category, i.e., technical, management, cost, etc., 


and report its recommendation including formal written 
rationale for the score to the FDO. 


Most PEB proceedings reviewed followed basically the 
same format. A typical sequence of events for the conduct 
of a PEB meeting would be as follows: [Ref. 93] 

1. Pertinent information for each voting member should 
be assembled. This information should include: 
a) Representative and monitor reports; 
b) A summary of the impact of scoring on fee deterni- 
Nation. This should include a breakdown of data 
by rating, award fee percentage, and corresponding 


dollar value for the award fee. 
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c) A copy of previous period PEB recommendation 
letters. 

d) A copy of the performance ratings and criteria. 

e) A list of key milestone events for the period. 

The contractor is normally invited to attend the 

first and second segments of the PEB meeting. 


Attendance is generally limited to a few key manage- 


ment personnel. Documentation used by the board is 
not, nor should it be, made available to the 
COneracror. 


The first segment of the PEB meeting, for participa- 
tion of contractor personnel, normally consists of a 
presentation by the contractor, if desired, followed 
by questions presented to the contractor resulting 
fron board members review of Government and 
ccntractor input. All representatives' presentations 
for each category the contractor wishes to address 
shouid precede guestions to the contractor. It is at 
this point that the contractor's active participation 
in the PEB should be comrfieted. 

The second segment of the PEB meeting generally 
consists of a discussion led by predesignated 
Government representatives as category leaders of the 
pertinent points. This seyment may be attended by a 


top contractor management representative, usually 
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above the program Supervisory level, but should not 
include further input by the contractor. The discus- 
Sion usually begins with a summarization by the 
category leader with a recommended score, followed by 
comments from other board members. The contractor 
representative who is present during this segment 
assumes a paSSive role. 

The third segment of the PEB meeting generaily 
consists of determining performance ratings for each 
score and finalizing a recommendation letter which 
Supports the ratings. The contractor is not to be 
present during this segment. Any discussion of 
performance should be to justify a recommended Score, 
put should not present any new information. Previous 
period letters are to be reviewed so that members are 
aware of previous ratings given in order to be akle 
to hignlight improved areas or continued problem 
areas in making the evaluation of performance. 

Each category leader then summarizes the facts fron 
preformance ratings established during negotiations 
and presents an adjective rating. 

The scoring precedure is either by member negotiation 
(Majority opinion) or averaging. Neither method is 
recommended over the other; however, consistency from 


one period to the next should be maintained. The 
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System chosen for use shculd be a part of the imple- 
mentation plan. In accordance with a pre-established 
scoring sheet, the final rating is the weighted 
average of the category scores. The PEB generally 
remains ih session untii a final letter is agreed 
upon by the voting members of the board for the FDO. 
One Project Manager has developed a set of unwritten 
rules for the conduct of the PEB proceedings. These rules 
are applicable to any PEB evaluation process and should be 
observed: 
1. Board members do not intimidate witnesses; 
2. Board members do not tfreveal to one witness what 
another witness said; 
3. Witnesses do not discuss their testimony with anyone 
else, including other witnesses; 
4. Witnesses testimony must be limited to the evaluation 
period with no reference to the events outside the 
period. 
All PEB members interviewed indicated that, alt hough. 
formalized, there was general agreement that the above 
guidelines were followed in most instances. 

The above sequence of events discussed for the PEB 
proceedings were common to all contracts reviewed, with one 
exception. The one difference of opinion centered around 


step two. Some Project Managers and Business/Financial 
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Namagiers [eCitestzongdy about not having a contractor repre- 
sentative present during presentations by the Government 
witnesses. It was felt that contractor representation would 
tend to intimidate the witnesses. Others indicated that 
this was not a concern. The researcher does not take a 
position favoring either side of the issue. On the one 
hand, intimidation of the witness may be a possibility. 
However, if the witnesses are prorfessionaily competent, 
Senior managers within the Government's on-site office and 
know that they have the support and backing of their super- 
visor who expects them to be honest and present a _ true 
picture of a contractor's perfcrmance, intimidation should 
not Fe of concern. Tn addaguaon, having the contractor 
representatives present during the testimony aliows senior 
contractor management to receive feedback "straight from the 
horse's mouth", This represents just one more opportunity 
to open and strengthen the line of communication between the 
Government and the contractor. The decision whether to 
allow contractor representatives to be present during 
Government witness testimony shculd remain with the discre- 
tion and better business judgement of the Project Manager. 
Che concern ccmmon throughout all PEB members inter- 
viewed was that the testimony from Government witnesses 
during the presentations and discussions too often did not 


agree with or support the grade recommended. witnesses are 
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generaliy mid-grade Government employees who work with the 
contractor on a daily basis. One of two Situations gener- 
ally existed. The first is that the grades recommended were 
often too low compared to the written input to the board. 
For example, a recommended grade of 70 percent would be 
accompanied by a description that indicates "performance is 
outstanding in most respects, with a few areas of major and 
Minor deficiencies", The seccnd situation encountered is 
just the opposite, where a recommended high grade is 
Supported with a relatively weak narrative description. 

The obvious solution to the problem described in the 
above paragraph ais a formalized training and education 
process for those who provide testimony to the PEB. 
Witnesses must realize the impact their testimony has on the 
PEB's proceedings and the eventual determination of award 


fees. This training should include how to write evaluations 


which support the reccmmended grade. 


C. AUTHORITY OF THE FEE DETERMINATION OFFICIAL 


An examination of the last key element in the evaluation 
of the fee determination process is appropriate; that is, an 
examination of the role and authority vested in the Fee 


Determination Official (FDO). 
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fenere of the 


jr 


ee Determination Official 


The FDO is the single tost important individual in 
the fee determination process. In ail contracts examined, 
the FIO was the Project Manager. In the arena of Rajor 
weapon systems acguisition, 1t is logical for the Project 
Manager to assume the role or the FDO. This function 
provides the Project Manager an additional opportunity to 


“Stay on top of the project" and be effective as the manager 


of the project. Every person interviewed indicated that an 
effective Project Manager wculd want to assume this 
Pome t On. 


As discussed earlier in this chapter, the FDO may or 
may not be a member of the PEB. If the FDO is a member of 
the PEB, then the FDC will assume the additional responsi- 


bilities of PEB Chairferson. 


oe AlenOrity of “the Pee Determination Official 


The Naval Material Ccmmand vests the following 


authority in the FDO: [Ref. 94}. 


The FDO shall, based on the recommendation of the PEB 
and any other pertinent infcrmation known, determine 


(emphasis added by the researcher) the award fee for the 
period in question. 
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The final award fee determination rests with the FDO, and 
only with the FDO. 

The findings of the PEB are only recommendations to 
the FDO. The FDO is not bound to follow the recommendations 
of the PEB, and may in fact medify the amount of the award 
fee based on "other pertinent information". dow often does 
the FDO disagree with the recommendations and input from the 
PoE In analyzing interviews conducted, the answer to this 
question really depends on whether or not the FDO plays an 
active role in the PEB. If the FDO is a member of the PEB, 
all of the concerns of each memter, including the FDO, are 
expressed prior to the determination of a grade. If the FDO 
disagrees with a determination, at ieast the FDO sat in on 
the PEB proceedings and is familiar with the logic behind 
the decision. In all cases invelved in this study where the 
FDO was also a member of the PEB, the FDO accepted the 
recommendations of the PEB and never modified the recon- 
mended score. 

In cases where the FDO did not sit in as a member of 
the PEB, cases of both agreement with the PZB recommenda- 
tions and disagreement were found. In one contract reviewed 
where the FDO was not a member of the PEB, the FDO always 
accepted the PEB's recommendations and never modified the 
amount of the award fee. Those individuals associated with 


this program insisted that the FDO's findings were not a 
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"rubber stamp," that the findirgs were complete and exten- 
Sive covering all ccncerns and guestions of the FDO. In 
this case, the PEB Chairperson was also the Deputy Progran 
Manager. As indicated py the BuSineSs/Financial Manager, 
the "Program Manager's concerns are also the Deputy Progran 
Manager's concerns. We all have to live and work together." 

In those cases where the FDO did not sit in asa 
member of the PEB and disagreed with the recommendations 
provided, the FDO would frequently modify the amount of the 
award fee. In no case observed did this modification result 
in a lower award fee being awarded to the contractor, ani 
most modifications were modest (1 to 2 percent) increases. 
The reascns given for these modifications were in all cases 


“"yalid reclamas" from the contractor. 
a. Potential for Abuse 


It 1S interesting to note that the NAVMAT 
guidance requires the PEB to report its "recommendation 
including formal written rationale for the score to the FDO" 
peer. 17 i. If the FDO does nct agree with the recommenda- 
tions of the PEB and modifies the award fee, no guidance 
available requires the FDO to document the rationale for 
this decision. In one contract examined, the PEB recon- 


mended the following ratings for the evaluation factors 


indicated: 
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Technical; Satistacvor, 
Schedule: Marginal 

Design to Cost: Satisfactory 
Cost Controls Maimeamar 


Management: Marginal 


These ratinys reflect the following definitions: 


ilies 


Satisfactory Performance: Represents 56 Touma 
percent of the potentiai award fee. The contractor 
has demonstrated an overall level of performance 
which meets the contract rejuiremenrts. 

Marginal Performance: Represents 26 to 55 percent of 
the potential award fee. The contractor has demon- 
strated an overall level of performance which is 


below the contract requirements. 


Without "apparent" justification, the FDO (who 


was also the Project Manager) modified tne PEB recommended 


grades to the following: 


Technical: Satisfactory 
schedule: Satisfactory 
Design to Cost: Good 
Cost>Contmol:  Satmaract cry 


Management: Satisfactory 


A "Good" grade represented 76 te 85 percent of the potetimam 


award fee and the contractor demonstrated an overall level 
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of performance which 1s Slightly higher than contract 
requirements. 

While there may be sufficient justification for 
the modifications, this information was not available either 
in the contract file or from those in the Program Office. 
The FDO has retired and was not available for questioning. 
Nevertheiess, four of five grades were increased without 


apparent documentaticn. 


D. DATA/TREND ANALYSIS OF AWART FEES 


Data from eighteen CPAF ccntracts, representing four 
different Project Offices, were obtained for review and 
anaiysis. These eighteen contracts had 117 individual eval- 
uation periods. The approximate total cost estimate for 
these eighteen contracts exceeded approximately 42.271 
oberon. AS a condition of naking the data available, the 
researcher agreed to Sanitize the data so that it would not 
be possible to identify any particular data set to the asso- 
ciated contract or Program Office. These data, tabulated in 
raw form, are presented in Appendix E. 

The data were examined in three ways; by individual 
Swmemaet, OY Program Office, and finally, by combining all 
data from every contract into a single data set. Baie hws Gm 
these three combinations will be discussed in the following 


sections. 
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The evaluaticn period for eacn of the eighteen 
contracts was three months in duration. Statistical sda 
were extracted from the raw data found in Appendix E£ for 
each contract and are presented in Table 4 These data 
included the minimum score awarded as a percentage of the 
amount of funds available in the award fee pool, the maxiaua 
score awarded as a percentage of the amount of funds avail- 
able in the award fee pool, the statistical mean, the stan- 
dard deviation, and the median of the amount of the award 
fee earned by the contractor. In addition, a correla@ien 
was derived between the "age" of the contract and the award 
fee earned. As the contractor's performance progressed and 
gained experience, was the contractor's behavior modified in 
response to the evaluation criteria and feedback provided by 
the FDO? If this was the case, one would expect it to be 
reflected by a strong positive correlation. On the cther 
hand, if the contractor's performance did not improve, this 
may be reflected by a lower award fee as the contract 
progresses and would represent a negative correlation. The 
statistical data presented in Table 4 have been tabulated by 
contract corresponding to the same contract number found in 


Appendix E. 
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As can be seen from Table 4, generalized statements 
cannot be arrived at concerning individual CPAF contracts. 
The minimum scores range from 29.4 percent to a high of 95 
percent, while the maximum sccres run froma low of 43.4 
percent toa perfect score of 100 percent. it is —iee 
intended to select a particular contract for comment; 
however it should be noted that ascore of 100 percent 
implies that the contractor did everything right! While 
certainly not impossible, a score of 100 percent raises 
questions about the quality of the evaluation criteria and 
almost mandates a close examination of the criteria. The 
evaluaticn criteria which result in a perfect score implies 
that only the contractor's strengths were targeted in the 
evaluaticn criteria, and perhaps other areas of potential 
weaknesses Should be examined for evaluation criteria in 
subseguent CPAF contracts with the contractor in order to 
provide proper motivation. In the particular case where a 
contractor earned a perfect sccre, this 100 percent grade 
did appear toward the end of ccntract performance. Figuce 
5-1 shows that as tne contractor gained experience and 
continued to be motivated to achieve higher scores, the 
scores did in fact increase over time, culminating ina 
perfect score at the end of contract performance. This is 
one example of how the "carrot and stick" approach to noti- 


vating behavior is utilized. 
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Figure 5.1 Progression of Award Fees. 


The mean scores ranged from a low of 38.7 percent to 
a high of 96.5 percent, while the standard deviations ranyed 
from a low of 1.3 percent to a high of 12.4 percent. The 
correlations ranged froma strong positive correlation of 
99.8 percent to a strong negative correlation of -88.0 
percent. Figure 5.2 shows graphically a positive correla- 


tion between time and the amount of award fee earned. As 
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the contractor progresses through performance, gains exferi- 
ence, and remains motivated to improve, this is reflected in 
higher award fees. On the other hand, Figure 5.3 demon- 
strates a situation with a negative correlation between tine 
and the amount of award fee éarned. As the conttageen 
progresses through time and does not remain motivated, 
resulting in deteriorating performance, lower award fees 


over time are appropriate. 
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Figure 5.3 


2- Program Qffice Data 


Data for the é€ighteen 
Appendix E were combined into 
Offices. 


Statistical data 


researcner by Program Office 


Table 5 presents these data. 
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Award Fee Data kith Negative Correlation. 


individuai contracts found in 
their respective four Pregram 


were then extracted by the 


and follows Tabie 4 format. 


Program Office number four iS represented by ten 
contracts, Program Office number one by six contracts, and 
Program Offices two and three by only one contract each. It 
is interesting to examine the histograms from Progran 
Offices one and four. These histograms are presented in 
Figures 5.4 and 5.5 and represent the amount of award fee 
earned expressed aS a percentage of the amount of fee avail- 
able in the pool. Histograms from Program Offices twe and 


three are not provided because of the relatively small 
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humber of total evaluation periodS available in the two 


contracts involved; no significant trends are evident. The 
reader may obtain this information, if so desired, by 
reviewing Tables 13 and 14 in Appendix E. In examining 


Table 5, the researcher could detect no Significant data or 
trends. Data in Program Office's two and three must be 
discounted because they represent single contracts rather 
than combined mentracts aS in fFrogram Offices one and four. 
When examining the contract data in Program Offices one and 
four, there is no Significant correiation between the "age" 
of the contract and the amount of award fee earned by the 


contractor. 
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It cannot ke concluded from these two Program Offices that 
as the contractor's performance progresses, there iS a posi- 
tive motivational impact on the contractor which would be 
reflected in higher award fees earned (with a strong posi- 
tive correlation between time and award fee earned). One 
possible conclusion is that there is little or no positive 
correlation between time and the amount of award fee earned 
for any single contractor within individual Program Offices; 
indeed, Program Office four shows a negative correlation. 

An examination of Figures 5.4 and 5.5 show that the 
two Program Offices tend to skew the amount of award fee 
earned, expressed as a percentage of award fee available in 
the pool, to the high side of the scale, i.e., 80 percent 
and above. Vilsmis pabticuldlianly evident in Figure 5.5 and, 
as Will be seen later, this is also true throughout all 


Program Offices. 


3. Combined Contract Data 


Data found in Appendix E were combined into one 
Single data set from which statistical data could he 
extracted. These data are presented in Table 6 The histo- 
gram for this data set iS presented in Figure 5.6 and repre- 
sents the amount of award fee earned expressed as a 


percentage orf the amount of fee available in the pool. 
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TABLE 6 


Statistical Data From All Contracts Combined 


Mininunm Maximum Mean Standard Median 
Score Score Score Teviation Score Correl. 
mo 1.000 - 839 Seley. 377 - 2a 
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As can be seen from Table 6, there exists a slight 
correlation (24.7 percent) between the "age" of the contract 
and amount of award fee earned. The general tendency 
appears to be to increase the amount of the award fee earned 
as contractor performance progresses. AS seen earlier, this 
generalization cannot and should not be applied to indi- 
vidual contracts or individual Erogram Offices. 

The histogram shown in Figure 5.6 shows a definite 
skewing of the award fees to the high side (i.e., 80 percent 
and above) for all contracts combined. It is logligaliite 
assume that 1n most cases tnese high awards are the direct 
result of a skewing to the high side o£ recommended grades 


to the FDC from the PEB (assuming that the FDO does not 
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Figure 5.6 Histogram for Combined Contract Data. 


unilaterally increase the award fee with or without proper 
justification) . There appears to be a general tendency to 
award high grades. 

The question then becomes "What is a high grade?" 


Twelve of the eighteen contracts reviewed had a_e three 


percent ktase fee and a twelve percent award fee. An 
Naverage" grade has not been defined. However, if an 
average grade were defined as 50 percent, then an average 
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3% Base Fee + .50(12% Award Fee) = Qh , (5.8 


total fee would be as shown in eguation 5.1 if "average" 
performance were to equate to an 80 percent award fee (as it 
appears to be the case with award fees skewed to the high 


side), then an average total fee would jump to 12.6 percent, 


3% Base Fee + .80(12% Award Fee) = 12.6% (S525 


eyuation 5.2 shows this. With a 90 percent "average" score, 
the total fee earned would be 13.8 percent. Equation yo 
demonstrates this. 

This skewing of award fees to the high side can 


create problems for the Contracting Officer at a later date 


3% Base Fee + .90(12% Award Fee) = 13.8% ( Sigase 


during subsequent contract negctiations. AS a partiegg@as 
project matures, the type of contract is more than likely to 
Migrate from a cost-reimbursenent type of contract to a 
fixed-price type of contract. As this occurs and the 
contractor assumeS a greater Share of the risk, the 
contractor Should expect to be compensated for the greater 
assumption of risk through higher profit (or fee). Ic the 


contractor has been earning 1z2 to 14 percent ona CPAF 
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contract, it may be impossible to get the contractor to 
agree on a profit rate of 10 or 11 percent on subseguent 
fixed-price contracts. Although the researcher does not 
Propose that 10 to 11 percent saould be the standard profit 
on a fixed-price type of contract, some interviewees indi- 
cated that there does seem to be a"10 percent mentality" 
when discussiny fixed-price profit rates. As shown in equa- 
tion 5.1, an average grade of 50 percent would result ina 9 
percent total fee, making it easier to transition to a fixed 
price type of contract with a profit rate of 10to 11 
percent. 

Although weighted guidelines do not apply to CPAF 
contracts, [{Ref. 86] a brief examination of the weighted 
guidelines was conducted to determine the impact on the fee 
if weighted guidelines did apply. The percentage range for 
zee objectives for a CPAF contract was selected by tne 
researcher as 1.5 to 3 percent, to reflect asSumpticn of 
cost risk for a cost reimbursement type contract with a 
Peeerervery” high degree of risk, and & to 6 percent for a 
FPIF contract with multiple incentives. If all weighted 
guideline elements, with the exception of contract cost 
risk, are held constant, then the difference in fee/profit 
can be attributed to only the assumption of cost f1risk. 
Using a measurement base of $100,000 for simplicity, the 


CPAF contract fee would be between $1,500 and $3,000, and 


145 


the FPIF profit would be between $4,000 and $6,900. Notice 
that in all cases, the CPAF fee wouid be below the FPIF 
profit objective. When the project then migrates irom a 
CPAF contract to a fixed-price type of contract, the 
contractor would then realize an increase in profit/fee. In 
reality, this is not the case when the CPAF fee is between 
12 to 14 percent and the Government attempts to negotiate a 
profit objective of 10 to 11 percent on a fixed-price type 
Of COnrEbacer. 

It appears logical to conclude then that the general 


tendency is to award gradeS which are too high. As shown in 


Table 6, the mean (or average) award fee was nearly 84 
percent, with a median award fee earned of nearly 88 
percent. 


E. CONCLUSION 


Proper administration of CEAF contracts is critical to 
the success of the award fee concept. For CPAF contracts to 
succeed, the concept of a post-performance subjective evaiu- 
ation by the Government must have the support of the 
COREEaAGEOE. For this to occur, the contractor must) Gea 
that a fair and equitable evaluation is being conducted. 
Because of this, the PEB must have representation from the 


on-site office as a member of the Board. 
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This idea of a fair and eguitable evaluation is also a 
two-edged sword. The evaluation must also be fair and equi- 
table to the Government. AS pointed out earlier, the poten- 
tial exists for the FLO to abuse his authority. In the one 
instance cited earlier, the FDC appears to have abusec his 
position by raising the recommended grades of the PEB 
without documented justification. The reverse is also 
possible; the FDO could also dJlower the recommended grades. 
In either case, controls over these possibilities are 
needed. Such controls should include the FDC justifying his 
actions in writing and filing this documentation for future 


reference. 
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VI. CONCLUSIONS AND RECOMMENDATIONS 


PE SEF SS _— [= = = ee eee ST Eee oe 


Ae CONCLUSIONS 


The following concluSions apfply to this researcn effort: 


1. 


Improvements to the award fee determination process 
are needed. The process needs to be improved fer two 
reasons. First, as discussed in Chapter IV, section 
B, CPAF contracts are being criticized as "give away" 
programs, particularly when roll over provisions are 
used which are considered "gitts to the contractor! 
and allow the contractor "muitiple bites at the 
apple." The second reason the award fee determina- 
tion process needs to be improved is that CPAF 
contracts do not have the full support of those who 
currently set policy. As discussed in Chapter II, 
section E, and in Chapter IV, section B, this lack of 
Support, or confidence, 1s reflected in increased 
restrictions on the use of CPAF contlag@pe 
Specifically, these increased restrictions include a 
threshold of $25 Million on the use of “Gra 
contracts, and that _ of carry forward provisions 
£ Ore unearned award fees are expressly prohikited 


Without prior approval from Chief of Naval Material. 
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The base fee is gereraliy too high. AS discussed in 
Chapter IV, section A, the majority of Government 
personnel interviewed indicated that the base fee 
Should be three percent. However, these individuals 
seem to have lost sight or the basics and could not 
logically support a three percent base fee, other 
than "it's authorized in the FAR" or "it appears to 
be the standard." As Dr. Meiners indicated, "the 
base fee, when originally conceived, was intended 
only to cover the contractor's unallowable costs, 
which historically have been two percent." This 
naturally assumes that there is a potential for the 
contractor to earn none of the fee available in the 
award fee pocil. Dx . Meiners also indicated that 
"there is no other type of contract where funds are 
set aSide specifically to Cover unallowable 
expenses." These expenses are normally covered by 
the standard profit or fee the contractor earns. The 
use of a base fee should only be for those situaticns 
where the Government and the contractor are so 
concerned with and anticipate a large number of 
uncertainties that the ccntractor will earn only the 
base fee. This would certainly be the exception 


rather than the rule. 
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The current restrictions on the use of rell over 
IV, section B, circumstances may exist which favor 
use of roll over provisicns. Use of roll over provi- 
sions should be an option to provide management flex- 


ibility to the Program Manager. 


Performance ratings ard performance evaluation 
criteria are too subjective. As seen in Chapter iy 


section C, the most commonly used performance rating 
is the adjective-type standard rating system which 
indexes a performance guality adjective and corre- 
sponding explanation-to a percentage of tne potential 
award fee available during the evaluation period. 


Similarly, evaluation criteria tends to be too broad 


and not well-defined. This leads to confusion and 
exposes the award fee determination process to 
CLitieisime 


The following four criteria must first be examine 
determining the length of the evaluation period: 


Projected stength 


ou the contract, contract 
complexity, size of the contract, and administrative 
reguirements. As discussed in Chapter IV, section D, 
there is no cookbook solution to determining - the 
length of the evaluation period. Such a decision, 


however, should not be made if any of the above four 
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elements are not first considered inthe decision- 


Making process. 
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awarding the contractor for unsatisfactory perfora- 
ance and can be difficult to understand. As seen in 

Chapter IV, section E, the criteria in selectiny a 
formula are that it shculd be relatively easy to 
understand, ieaves little room for confusion, is not 


subject to interpretaticn, and does not reward the 


contractor for unsatisfactory performance. 
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Site field office representation. As seen ir. 
Chapter V, section B, on-site representation reduces 
neediess criticism and froblems for the PEB. One 
contract reviewed lacked on-site representation on 
the PEB, and was the sukject of severe criticism for 


not being well-palanced. 


The potential exists for the Fee Determination 
Official to modify award fee recommendations without 
apparent justification. As seen in Chapter V, 


section C, in one contract examined the FDO unilater- 
ally raised four of five recommended grades without 
apparent justification. Aithough the excerftion 


rather than the rule, the FDO has’ the authority to 


1S 


TO 


unilaterally adjust recommended grades from the PEB. 
While tnere may be sufficient justification for the 
modifications, this information was not available 
either in the contract file or from tnose in the 


Program Office. 
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nt of a training program for CPAF contracts 
As discussed in Chapter II, section fF, one of the 
disadvantages of CPAF contracts is the complexity 
inherent in administering the contract. A formalized 
training program for CPAF contracts currently does 
not exist. 

ees provided under CPAF contracts have a 
be too high. As discussed in Chapter V, 
section D, the average award fee is nearly 84 percent 
and the median award fee is nearly 88 percent. Tie 
contract with a three percent base fee anda twelve 
percent award fee, the total fee earned by the 
contractor (given a recommended award fee of 84 
percent) 1s over thirteen percent. This creates 
serious problems when the program migrates from a 
cost-reimbursement type cf contract to a fixed-price 


CY Pe Cr eCOnmnace. 
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Be RECOMMENDATIONS 


The following recommendaticns are appropriate for this 


study: 


1. 


mendation would accomplish two things. PLES [eee 
would result in the total fee earned by the 
contractor to be lower. For example, if the award 


fee pool were 12 percent with a base fee of three 
percent, total fee earned by the contractor would be 
12.6 percent with an award fee grade of 80 percent. 
However, if the base fee were zero, and the award fee 
fool were 15 percent, total fee earned with an 80 
percent award fee grade would be only 12. fercent. 
This would make it easier to transition from a cost- 
reimbursement type of contract to a fixed-price type 
oe Contract. Secondly, use of a zero base fee would 
reduce criticism that award fee contracts are "give 
away" programs, This recommendation is significant 
because it contradicts "traditional" attitudes toward 
use of base fees and reyuires that attitudes be 
adjusted throughout the acquisition community. hs 


recommendation may be implemented through 
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promulgation of a policy statement Of InNStructiOnmae 
the Systems Command level. 


That the Chief of Naval Material ease the current 


restrictions on use of roll over provisions ZOE Rime 
award fee pool. This recommendation would return 
Management flexibility tc the Program Manager. This 
recommendation is significant because roll over 
provisions have been, and will continue to be, 
controversial. Tmplementation would require a modi- 
Eication to current NAVMAT policy eam NAVMAT 


Instruction 4280.1A. 

That performance ratings use only numerical descrip- 
tors Lather than numeric/adjective ratings. This 
recommendation makes the award fee determination 
process less subjective, and thus more objective, by 
creating relativity for the performance rating when 
ccmpared against a perfect score of 100 percent. 
This recommendation is also controversial because 
there are those who favor use of combined numeric and 
adjective rating systems. This recommendation nay 
also be implemented through promulgation of a policy 
Statement or instructicn at the Systems Command 
level. 

That guidance be promulgated outlining the desired 
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evaluation criteria becomes more detailed, the 
subjectiveness inherent in the award fee deternmina- 
tion process is reduced, thereby eliminating some of 
the criticism being levied against award fees. This 
recommendation is significant because the tendency is 
to promulgate broad, Nen-specific guidance leaving 
room for interpretation and adjustments to individual 
programs. In the researcher's opinion, evaluation 
criteria iS one area where detailed guidance is 
appropriate, and may be promulgated through a poiicy 
statement or instructicn at the Systems Command 
level. 

That “logistics supportabiiityv" be included as a 
mouth evaluation element. This recommendation would 
increase the number of evaluation elements nost 
commonly used to four. These elements would be 
technical/management performance, schedule perforn- 
onee, cost control, wand logistiressupportability. 
This recommendation is necessary to give logistics 
supportability proper recognition and support fron 
management, and can be implemented through a policy 
statement or instructicn at the Systems Command 
level. 


wendamiGies be omulgated "highly recommending" 


ee ee —_ =_— ae CEE ems eS ——— a gee SSS 


1D 


Board. Although lack of on-site PEB representatmaa 
occurred in only one contract and may be an isolated 
incident, tnis recommendation closes a significant 
lcop-hole in current guidance. This recommendation 
would help prevent future "apparent lack of fair and 
opjective evaluations" and thus help eliminate a 
source of award fee criticisn. Implementation is 
possible through a policy statement or instruction at 


the Systems Ccmmand level. 


modify the scores recommended by the Performance 





Evaluation Board and/or the award fee, the Béaseae 


and logic for this acticn should be well-documented 


in writing and retained in the contract file for 


future reference. The FDO should retain the flexi- 
bility to disagree with the PEB and modify the award 
fees. The responsibility to determine the award fee 
is inherent in the position of the FDO. However, 
this recommendation will help limit the potential for 
abuse of this authority, even if all that it acccn- 
plishes is to make the FDO think twice prior to 
taking such action. This recommendation is signifi- 
cant because action must be taken to elininate the 


potential for even "apparent abuses of the FDO's 


anthoraiiy aM Implementation is possible through a 
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Polmsey, Statement Or arstruction at the Systems 


Command level. 


motivation factors, evaluation criteria and methods, 
responsibilities of those who monitor contractor 
performance and provide input and testimony to tke 
Pb, as well as other ‘factors unigue to CPAF 
contracts. This recommendation fills a void and true 
need for those who use CPAF contracts in the field, 
and 1S significant because no such program currently 
exists. Ideally, implementation can be achieved 
through the Chief of Naval Material oroviding funds 
for an educational institution to develop and export 


such a program to the field. 


Structures for "average" performance. AS seen 
earlier, award fees prcevided under CPAF contracts 
have a tendency to be tco high. FDOS must gair an 
awareness of the impact high award fees have on the 
future and make necessary adjustments. This recon- 
mendation would resuit in lower fees earned by the 


contractor who is "average" where "average" is 


defined as 50 percent rather than the current 84 
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percent. This recommendation would also help reduce 
the criticism that CPAF contractS are "give away" 
programs. The significance of such a recommendation 
is apparent. Defense ccntractors can be expected to 
react negatively to such an action. However, if the 
contractor is to be fairly compensated (fair for both 
the Government and the centractor) for the assumption 
of risk, the lowering cf CPAF total fees is appro- 
priate. Without the prenulgation of such guidance, 
the skewing of award fees to the high side will prob- 
ably continue and may in fact grow. This sae 
continue to make it difficult to migrate from a cost- 
reimbursement type of contract to a fixed-price type 
OL COn@pact. Implementation of this recommendation 
1S perhaps best through a policy statement or 


instruction issued by NAVMAT. 


C. ANSWERS TO RESEARCH QUESTIONS 


ile 


What are the key characteristics of the award fee 
determination process under CPAF contracts for dajor 
Weapon Systems acquisiticn and how might this process 


be improved? 


Identification of the key characteristics of the 


award fee determination frocess is really a two step 
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process. The first ster involves an examinaticn of 
pre-award activities andthe development and struc- 
turing of contract elements which influence the award 
fee determination process. These elements and activ- 
ities include the formulation of the base fee, deter- 
Mining how the award fee pool is to be used, 
formulatiny the evaluation criteria and performance 
ratings, determining the length of the evaluation 
period, and finally, development of an appropriate 
formula to compute the fee. The second step involves 
contract administration functions in terms of evalu- 
ating performance and fee determination procedures. 
This step includes an examination of the PEB composi- 
tion and proceedings as well as the role and 
authority of the FDO. IhnlS process can be improved 
through the implementation of the recommendations of 
this study which include: 
a) Use of a base fee of zero as a general rule; 
b) Easing of the current restrictions on the use of 
roll over provisions; 
c) Performance ratings should use only numerical 
descriptors; 
d) Use of more detailed evaluation criteria; 
Seeenciude "]logisties. supportability" as..an evalua- 


PEon selene pit); 


t9 


ff) Pronulgacrng guidance Wha Gy: recommending" 
on-site representation on the PEB; 

g) That the FLO be required to document in writing 
any modifications to the recommended award fee; 

h) That a training program for CPAF contracts jae 
developed; and 

1) That guidance be promulgated which identifies 


grade structures for "average" performance. 


What are the basic concepts and assumptions in the 


award fee determination frocess? 


The basic concept is that the award fee determination 
process is a unilateral subjective evaluation, 
conducted by the Government following contractor 
performance, which is nct subject to dispute by the 
ccntractor. The basic assumption is that the evalua- 
tion is fair and eguitatle, both to the contractor 


and to the Government. 


What are the key criteria used to evaluate contractor 
performance and how have these criteria been 


utilized? 


Three criteria have been most often used. These are 
technical/management performance, schedule perforn- 


ance, .and cost control. Some contracts nave broken 
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out "Management performance" as a separate element. 
In addition, "design-to-cost" has been used at times. 
A fourth element, logistics supportability, is recon- 
mended for consideration as one of the key evaluation 
criteria as this area grows in importance. The 
problem with use of all criteria generally has been 
that they are vague and not well-defined. More 
detailed information in the criteria can reduce scmne 
of the subjectivity in the process and add an element 


of objectivity, which is needed to reduce criticism. 


What are the significant issues and problems in 


contractor performance evaluation? 


In addition to vague and not well-defined evaluation 
criteria, formal training for those directly respon- 
sible for providing input to the PEB and FDO does not 
exist. The potential exists for the FDO to abuse his 
authority and either increase or decrease the reccn- 
mendations of the PEB without apparent justification. 
Lack of on-Site representation on the PEB is also 
another potential problem. Another issue involves 
determination of the length of the performance evalu- 


ation period. 
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What guidelines are used by the FDO in determining 
the quality of contractor's performance and amount of 


award fee? 


Formal guidelines provided by the Naval Material 
Command leave maximum flexibility and use of profes- 


Sional judgement to the FDO [Ref. 95}. 


The FDO snall, based on the recommendation of the 
PEB and any other pertinent intormation known, 
determine the award fee for the period in 
question. 


What input does the contractor have in the award fee 


determination process? 


Very little. The evaluation criteria is subject to 
negotiation prior to formalization of the Comtiae 
Once the process is in place, most PEBs allow the 
contractor the opportunity to make a presentation, if 
desired, to the PEB which is followed by guestions 
presented to the contractor resulting from koard 


members review of Government and contractor input. 


What modifications should be made to improve tne fee 


determination frocess? 
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The award fee determination process can be improved 

throuyh implementation of the recommendations of this 

Simey sand partictilarly’ by: 

a) Use of a base fee of zero as a general ruie; 

b) Easing of the restrictions on the use of roll over 
provisions; 

c) Use of only numerical descriptors for performance 
imclieteN).C\ Sis 

d) Use of more detailed evaluation criteria; 

e) Including "logistic supportability" as an evalua- 
tion element; 

£) Promulgating guidance "highly recommending" 
on-Site representation on the PEB; 

g) That the FDO be reguired to document in writing 
any modifications to the recommended award fee; 

mi ihat wa@etraimang eprogram for CPAF contracts be 
developed; and 

i) That guidance be promulgated which identifies 


grade structures for "average" performance. 


How are funds utilized which remain in the award fee 
pool after the award fee determination decisicn is 


nade? 


Two schools of thought exist, and both are currently 


in use. The first is that once the contractor is 
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awarded funds from the pcol, any funds which remain 
in the pool should be lest as far as the contractor 
1s concerned. These funds would then be recouped by 
the Government and used for other purposes. The 
second school of thought is that a percentage of the 
funds which remain in the pool be rolled forward into 
subsequent evaluation  feriods, thus giving the 


contractor a "second bite at the apple". 


The amount of the award fee is limited by the size of 
the award fee pool. Measuring the award fee asa 
percentage of the award fee pool, what trends, if 


any, are evident? 


Generalized statements about individual contracts are 
not possible. As a centractor progresses through 
contract performance and gains experience, a positive 
Correlation between evaluation period and award iee 
earned should result. This should occur because the 
contractor Wlearns" how to respond te the 
Government's feedback, makes the appropriate adjust- 
ments, and shows improved Peete cmcn aia subs eg- 
uent evaluaticns with a payoff of higher award fees 
earned. This indeed occurred in several situations. 
HOwever, negative correlations also were evident. 


When examined ina combined data set, a definite 
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Skewing OL award fees to*the high side ({i.e., 80 
percent and above) occurred. The average award fee 
was nearly 84% percent and the median award fee was 
nearly 88 percent for the combined data set. Award 
fees this high, when the contract has a three percent 
base fee and atwelve percent award fee provision, 
results ina total fee earned of between twelve and 
fourteen percent, making it difficult to migrate toa 
Pxeecueprerece type of contract with a target profit 


objective of ten or eleven percent. 


D. RECOMMENDATIONS FOR FURTHER STUDY 


line 


MidtmamcOst—Denerait analysis be conducted to measure 
the benefits and costs of administering. CPAF 
contracts. If the cost of administering a CPAF 
contract is in excess of any benefits which may 
accrue to the Government, a contract form other than 
CPAF should be utilized. The problem then becomes 
one of how to measure the benefits and costs of 
administration. 

Examine the development of a training program and 
Manual for CPAF contracts for both contract fornula- 


tion and administration. 
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Development of a model tc be used in identifying the 
appropriate weightings to be applied to the evalua- 
tion criteria during specific phases of the project. 
How much weight, for example, Should be applied to 


cost control and in what phases of the contract? 
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APPENDIX A 


INTERVIEW QUESTIONNAIRE 


ENZRA 


What is the purpose, as you perceive it, of a cost 
plus award fee type contract? 

Do you think that costs are adeguately considered in 
the evaluation of the award fee? 

Consider the proposal that it be mandatory for cost 
controls to be at least 50% of the award fee evalua- 
Pilcnemee Fi tenia What is your reaction to such a 
Proposal? 

What do you think could most contribute to cost over- 
Cuns on a CPAF contract and what should be done about 
iter 

What level should the base fee be set at? (ees, OR; 
2%, 5%, etc.) What criteria should be used in making 
this determination? 

What criteria is used to determine the amount of the 
award fee for the evaluation period? 

How long should the award fee evaluation period he? 
What criteria should be used in making this 


determination? 
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14. 
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What do you see as the key characteristics of the 
award fee determination frocess? 

What do you see as the baSic concepts and assumptions 
in the award fee determination process? (Descriptive 
response) 

What do you see as the rajor factors/characteristics 
inherent in the process and how do they contribute to 
the award fee? (Evaluative response) 

What do you see as the key criteria to be used to 
evaluate contractor performance and anow have these 
criteria been utilized? 

What are the significant issues and problems in 
contractor performance evaluation? 

What input does the contractor have in the award fee 
determination process? What input Should the 
contractor have? 

Why do award fee provisions generate controversy in 
the contract environment? 

How do you view the award fee determination process 
and what are your likes and dislikes? 

What criteria are available to evaluate contractor 
performance? 

How are funds which remain in the award fee pool, 
after the award fee determination OC eHIOn 1s made, 


utilized? How should they be utilized? 
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C. 


noeeett you Coutdedo two or three things to modify and 
improve the award fee determination process, what 
would they be? 

1. What positions “and grades comprise the Performance 
Evaluation Board (PEB)? Do any members of the PEB 
represent the on-site office? If not, why not? 

2. What 1S your opinion of the quality of the input fron 
the PEB? How could the input be improved? 

3. How often do you disagree with the PEB input and 
recommendations? 

4. Consider the proposal making it mandatory that the 
PEB be composed of some representation from the 
on-site office. What is your opinion of that 
proposal? What kind of representation should this 
be? What positions/backgrounds should the represen- 
tatives have? (OA; auditing» taneance, production, 
engineers, etc.). 

5S. What kind of influence does the contractor's input 


have on the fee determination? 
POLICY 


What guidelines have kEeen published to assist the 


PEB/FDO in the award fee evaluation process? 
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APPENDIX B 
PERFORMANCE EVALUATION REPORT CRITERIA 
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CONTRACTOR PERFORMANCE EVALUATION REPORT 
(J) Example of Contractor Performance Evaluation Report. 
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EVALUATION CRITERIA 


The following evaluation criteria considerations were 
adapted, in part, from Naval Sea Systems Command Draft 
fmeermuction 4700, "Surface Ship Availability Contracts," but 
may be modified and utilized, where appropriate, with nearly 
any type Of CPAF contract for major weapons systems 


acquisition. 
a. TechnicalyManagement Performance 


Major considerations in the technical anc 
Management performance elements are: 

1. The effectiveness of the management organization in 
problem anticipation and avoidance, as well as imple- 
mentation of timely corrective action in problen 
areas which could impact successful completion of the 
contract should be evaluated. Consideration should 
be given to the prevention of schedule slippage or 
cost escaiaticn through the use of budgeting tech- 
niques, material selection, Subcontractor uti 117a— 


tion, and manpower loading. 


igs 


The responsiveness of the purchasing organization in 
obtaining and providing the parts, material and 
equipment necessary to faintain schedules should be 
evaluated. Factors such as the trumber of jobs held 
up because orf lack of material, cost savings obtained 
through the use of economic purchasirg technigues, 
and the avoidance of exfenditures on such things as 


premium transportation costs should be considered. 


The selection of cost effective materials, when 
several approved options exist, Should also be 
considered. 


The responsiveness of the engineering organization in 
issuing drawings, sketches, work item specifications, 
technical instructions, and Similac documents 
required by the contract administrators should be 
evaluated. Use of simple solutions and economic work 
methods fcr jok accomplishment should be considered. 
The number oi jobs held up for lack of engineering 
information and rapidity with which engineering [frob- 
lems are resclved should also be considered. The 
degree of rework caused by inadequate contractor 
technical documentations and solutions to rework 
requirements should be considered. 

Subcontractor Management: The ability of Sime 


contractor to _ select, enhance competition, and 
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effectively manage subccntractors, both material/ 
service vendors and on site subcontractors, should be 
evaluated. Thewschedulle/cost impact, of jobs, heid up 
for vendor provided material, technical data and/or 
delays caused by on site subcontractors should be 
considered. Efforts made to keep subcontractor costs 
to a minimum should also be considered. 

Cofiguration Control: Effectiveness in oktaining 
materials and performing repairs and lterations in 
conformance with approved drawings and technical data 
Should be evaluated. Tinely submission of configura- 
tion control data to the Governaent should also be of 
consideration. 

Data Wanagement: The effectiveness of ccntractor 
utilization of Government Furnished Information (GFI) 
snould be evaluated. The contractor should be evalu- 
ated on his effectiveness in detecting consequential 
technical errors in GFI frior to production, and on 
the effectiveness in working with the Government to 
resolve such problems tefore they have an adverse 
CoOSt eam pact. The contractor should be judged on his 
ability to apply GFI to engineering of work, and use 
of GFI in installation, test, and checkout of 


ccmpleted work. 


5 
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Quality Assurance: The effectiveness of the guaiity 
assurance organization in fulfilling the in-process, 
as well as the at-completion, guality requirements of 
the contract should ke assessed. Effectiveness in 
identifying and correcting guality deficiencies and 
their causes in a timely manner Should be considered. 
The contractor's managenent approach to fulfiliing 
the guality reguirements of the contract, cleanliness 
of interface work areas, and as-found testing 
requirements should also be considered. 

pffectiveness of the contractor's ability to control 
costs and to avoid unnecessary cost increases should 
be evaluated. Particuiar emphasis should be placed 
on the contractor's ability to maintain the initial 
budget and to make cost effective decisions with 
respect to technical regquirements, schedule, and 
quality Coptee: 

Change Orders: The tinely submission of condition 
reports by the contractor, cooperation in negotiation 
of changes, and willingness to provide information 
needed by the Government for timely negotiations 
should be considered. 

Liaison With the Project Manager and other 
Government representatives should be evaluated. This 


includes stability of tke CODtmact or project 
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italics 
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eo 


organization, established management procedures, and 
COMmenactorn atratudes. 

The use of Facilities Capital Cost of Money for 
productivity enhancing capital investments should be 
considered. 

Contractor personnei management procedures should be 
evaluated, including the minimization of turnover, 
training programs, and afprentice programs. 

Integrated logistics sufport efforts should te eval- 
uated, including provisions of technical docunenta- 
tion, repair parts ordering, technical manuals, and 


bRainings 


ie Schedule Performance 


Major considerations in structuring evaluation 


criteria for scnedule performance include: 


alias 


Effectiveness in establishing and Daa@ntaining a 
timely and efficient scheduling system should be 
evaluated. Particular emphasis should be placed on 
establishment and timely updating of a scheduling 
system that properly integrates contractor furnished 
material, Government furnished material and produc- 
buona bor,  ancluding subcontractor efforts, into a 
rational and cost effective plan for completion of 


the contract. 
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Effectiveness in meeting preplanned milestones should 
be evaluated. Particular consideration should be 
given to the contracton’s dba, to Maintain 
adequate progress in anticipation of completion of 
milestones. 

Effectiveness in measuring schedule progress using 
preplanned milestones ard critical paths should be 
evaluated. Communication with appropriate Government 
representatives regarding appraisal or performance 
related to critical paths should be highlighted. 
effectiveness in the reccvery from and the correction 
of causes leading to wnissed events Should be 
considered. 

Effectiveness in integrating Government work items 
into contractor schedules should be evaluated. 
Particular emphasis should be placed on the coordina- 
tion with appropriate Gevernment representatives of 
milestones with joint responsibility. 

Effectiveness of Manpower utilization to meet plan- 
Ding and production schedules should be evaluated. 
This should include items such as methods and proce- 
dures to reduce the amcunts of premium time used to 
Minimize time lost on the job and between jobs, and 
to perform work with a reasonable number of qualified 


personnel. The contractor's effectiveness in 
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controlling fluctuatious of manpower reyuirements, so 
as to enhance stabilization of overhead rates, should 


also be considered. 
ec. Cost Performance 


Major considerations in structuring evaluation 
criteria for cost performance include: 

1. Effectiveness in meeting the cost performance plan 
submitted in the cost performance report should be 
evaluated. Results of cost avoidance practices 
Should aiso be considered. 

2. Consideration should be given to the timely and ageu— 
rate submission of the cost performance refort and 
cost status of funds repcrt. 

3. Ezfectiveness in identifying early cost and schedule 
problems, including timely variance analysis, as well 
as erfectiveness in dealing with identified probiens, 


should be evaluated. 
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PRESENTATION OF AWARD FEE DATA 


Data from eighteen CPAF contracts representing four 
difrerent Project Offices were cbtained for review and anal- 
ysis. The approximate total cost estimate for these 
eighteen contracts exceeded $2.2z71 billion. These data were 
provided to the researcher ky evaluation period, and 
included the amount of funds available in the award fee pool 
to be awarded during the evaluation period and the amount 
actually awarded. From these data the researcher calculated 
the percentage of award fee earned. These data are 
presented in the following tables. As a condition of making 
the data available, the researcher agreed to sanitize the 
data so that it would not be possible to identify any 
particular data set to the associated contract or Project 
Office. For this reason, the data tables have been labeled 


with generic titles. 
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TABLE 7 
Contract Number 1 Award Fee Data 
AWARD FEE AWARD FEE PERCENTAGE 
PERIOD POOL EARNED EARNED 
1 12073335 112,088 sODg 
2 86,890 Sie 77 940 
3 Sens 3 83,764 949 
4 S77309 82,634 939 
5 88, 259 83,846 ~949 
6 261,640 248,558 -950 
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TABLE 8 


AWARD FEE 
FOOL 


766,644 

808,245 
1, 08D) 021 
1,183,159 
1,729,845 
2, 192 
2,728,907 
3,445,840 
2,658,280 
2,244, 326 
2,171,098 
2,242,872 
3,443,067 
1,902, 860 
2,190,540 
1,647, 348 
1,969,844 
1,579,241 

896,459 

864,613 

232,208 

£39,401 
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AWARD FEE 
EARNED 


613,315 
678,926 
834,018 
1, Ol gasmee 
1,383,876 
1,798,025 
2,046,681 
2,963,423 
2,286,121 
1,840,347 
1,780,390 
1,973,728 
2,961,020 
1,427,145 
1,971, 486 
1,482,613 
1,871,352 
1,500,279 
851,636 
864,613 
225,242 
528,612 
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Contract Number 2 Award Fee Data 


PERCENTAGE 
EARNED 
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TABLE 9 


AWARD FEE 
FOOL 


1,489,600 
1,550,400 
1,088,320 
1,500,955 
1,575,201 
1,845,451 
2,057,383 
DIO ete 1 
2,442,299 
2,306,236 
2,002,590 
1,683,578 
1,725,049 
1,651,687 
2,050,300 
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AWARD FEE 
EARNED 


178657228 
1,426,368 
1,801,254 
1,350,859 
W453, 433 
1,679,460 
eS 7 2,219 
Lele oe 
2g! ON 
Z,i21,/37 
tee 27505 
1,481,548 
1,483,542 
oe 7,417] 
Woe? 78) 


Contract Number 3 Award Fee Data 


PERCENTAGE 
EARNED 
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TABDEM 0 | 

Contract Number 4 Award Fee Data | 

| 

AWARD FEE AWARD FEE PERCENTAGE | 

PERIOD FOOL EARNED EARNED | 
1 1,828,374 re cymes! 5) a) - 35 
2 1,495,457 1,420,684 - 95 
5 1,546,380 1,484,531 - 96 { 
Uf 1,469,993 1,425,893 a | | 
5 129537617 1,914,741 98 
6 ZS 7 ea 2 2,422,8/56 97 | 
7 2,613,734 2,261, 459 98 | 
Ree J 
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TABLE 11 


Contract Number 5 Award Fee Data 


AWARD FEE AWARD FEE PERCENTAGE 
PERIOD FCOL EARNED EARNED 
1 1,834,960 1,688, 163 Pe 
2 pool! 60 1,669,814 oa 
3 1,870,717 1,683,645 ae 
4 Ay sta, 19D 17805 ,07 2 -O7 
> Zee, 1.69 Zee poo 2 790 
6 2th Wg LO 2,613,807 oo 
4 Zoe 2 2,014,975 « 30 
8 2,247,463 432, 4 \6 290 
dg Zee, 213 Zp, O48 184) 
10 2,590, 523 2752 1,048 -97 
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TABLE 12 


Contract Number 6 Award Fee Data 
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AWARD FEE 
POOL 


1,834,960 
1,834, 960 
13 7 
2,974,795 
2,343,169 
2,871,876 
2,250, vieZ 
2,947,463 
2,4 (6ye27 3 
2a O 2S 
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AWARD FEE 
EARNED 


IgbeSrl63 
1,669,814 
1,683,645 
1/805,072 
PAPAS) 513) 5 74 
2,0tae07 
2, 0th 7 > 
2, 25247 16 
2,357,648 
Zp i,o4s 
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EARNED 
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TABLE 


Contract Number 7 


PERIOD 


woomrn) A Me WN a 


eee 
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AWARD FEE 
FOOL 


{zt OmG 27 
1,426,753 
1,749,991 
20057, 297 
sy a 9G 
2,761,805 
3,672,910 
3,006,110 
4,693,145 
5,342,630 
2,672,641 
1,955, 420 

606,591 
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Award Fee Data 


AWAKD FEE 
EARNED 


589,844 

910,342 
1,167,001 
2,027, 886 
1,647,416 
1,838,554 
Died 8, ONG 
Pao) Oa 
3,887,576 
3,153,124 
Pacueons 
1,480,196 

298,077 


PERCENTAGE 
EARNED 
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TABLE 14 


AWARD FEE 
POOL 


Dee 0 
3,744,407 
3,360,408 
4,149,431 
2,986,236 
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AWARD FEE 
POOL 


Leo 
600,614 
Osa Ue 


Contract Number 8 Award Fee Data 


AWARD FE 
EARNED 


1,721,095 
2,913,617 
2 SBReaS 
3,786,356 
2,812,661 


PERCENTAGE 
EARNED 
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Contract Number 9 Award Fee Data 


AWARD FEE 
BARNED 


1iZijzoe 
260,847 
321,936 


PERCENTAGE 
EARNED 
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TABLE 16 


Contract Number 10 Award Fee Data 


AWARD FEE 
PERIOD POOL 
1 2997038 
2 lt biz 0'o 
S 1,484,706 


TABLE 


Contract Number 11 


AWARD FEE 
PERIOD POOL 
1 Soy 0 2 
2 ee 0 4 
5 660,546 
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AWARD FEE 
EARNED 


ey ges 3 O 
794,647 
lo oy.o 19 
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Award Fee Data 


AWARD FEE 
EARNED 


269,07 | 
597,664 
556,774 


PRRCEN TAGE 
EARNED 
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PERCENTAGE 
EARNED 
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AWARD FEE AWARD FEE 
PERIOD POOL EARNED 
1 126 2 2 710,616 
z 546,669 2167S 
5 D734 a0 Jol pon 
NEE Ee 
eee 
TABLE 19 


AWARD FEE 
PERIOD POOL 
1 aoc 18 
Zz 572,643 
3 704,297 


TABLE 18 


Contract Number 12 Award Fee Data 


Contract Number 13 Award Fee Data 


AWARD FEE 
EARNED 


fom, 213 
423,756 
615,030 
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PERCENTAGE 
EARNED 
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TABLE 20 
Contract Numper 1714 Award Fee 
AWARD FEE AWARD FEs 
PERIOD POOL GCARNED 
1 Sab L305 
2 55S] ft G2 54506 
3 874,848 POz-o42 
TABLE 21 
Contract Number 15 Award Fee 
AWARD FEE Pew Deer, 5, 
PERIOD POOL EARNED 
1 LOZ 3D Sez 9 7 
2 Sore 2 / 412,966 
S 964,537 TSS 46 
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Data 


PERCENTAGE 
EARNED 
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PERCENTAGE 
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Contract Number 17 


TABLE 22 


Contract Number 16 Award Fee Data 


AWARD FEE AWARD FEE 
POOL EARNED 
748,427 656,370 

1,074,847 968,437 

1,486,457 1,458,851 

TABLE 23 


AWARD FEE AWARD FEE 
POOL — EARNED 
708,388 DiGi o 
Dees) | 817,685 

17 eee 1,139,864 
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Award Fee Data 
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TABLE 24 


Contract Number 18 Award Fee Data 


AWARD FEE AWARD FEE PERCENTAGE 
BERaOD POOL EARNED EARNED 
1 306,351 258,254 ~ 843 
2 342,904 Sea oi oO 
S 12210 ,5 35 12 ae, = 51S 
4 1,470,808 maou, 1 53 OO) 
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